Skip to content

perf(layout): convert ready Boolean predicates directly to masks - #11346

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-10-ready-masks
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-10-ready-masks

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft supporting the scoped DataFusion Q1 gain. Full-suite screening is complete; DuckDB history uncertainty remains disclosed below.

Stack dependency: #11334. This PR targets that branch so its diff contains only this change.

Summary

Ready Boolean filter pieces currently pass through general array execution before becoming selection masks. Convert supported constant and host Boolean arrays directly to masks, preserving null-as-false filtering and bitmap offsets.

Stack base: ji/clickbench-v2-20261109-01-io-wakeups (da10665e5b0f) (s01). This is a shared scan-filter change; the benchmark uses V2 in both DataFusion and DuckDB.

Changes

  • Construct masks directly from Boolean constants and host Boolean buffers with supported validity representations, avoiding an execution context for those ready inputs.
  • Keep general execution for encoded or lazy predicates, lazy validity, and device-backed buffers. Eligibility checks do not access device memory.
  • Add tests for constants, nulls, independent bitmap offsets and padding, encoded/lazy fallback, device eligibility, and non-Boolean errors. All 29 targeted filter tests and fresh semantic validation passed.

Benchmark evidence

Warm ClickBench timings against this branch's exact dependency parent. Query IDs are zero-based; these are individual query gains, not whole-suite or additive gains.

Engine Query Parent median (ms) Candidate median (ms) Paired latency reduction 99% interval
DataFusion Q1 3.6743 3.6013 1.91% 1.62–2.24%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians. Displayed times are medians across processes, so their ratio need not exactly equal the paired estimate. Intervals are pointwise 99% bootstrap intervals. Each listed gain passes both the >1% interval rule and the exact paired sign test with Holm 1% correction across all 76 planned latency directions. Both execution orders and chronological sensitivity were reviewed; no post-warmup observations were excluded or controls subtracted. The sign test concerns how often a paired improvement exceeds 1%; the displayed interval estimates the mean log effect.

No other planned mask endpoint passes the corrected gain rule, including every DuckDB endpoint. DuckDB Q42 is only 0.43% faster (99% interval 0.23–0.61%), below the practical threshold. No Q42 or tail improvement is claimed; full-query-history behavior requires the separate screen.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

Only the focused DataFusion Q1 reduction of 1.91% qualifies as a gain; no DuckDB gain is added. All43 DuckDB Q42 medians/means rise 5.59%/4.22%, with mixed pair signs and control variation of comparable size. Q29 and other late-query estimates are similarly noisy. This screen creates no new coherent regression hold, but does not clear historical history-sensitive uncertainty or establish equivalence. Keep the scoped DF claim and disclose those limits; favorable Duck resource aggregates remain descriptive.

Validation

  • 29 targeted test executions passed on this exact source tree: scan::execution::filter::tests.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: 3822bb6f9c783ac29ef0ac7178fd05e18f09e68d; full source tree: 7ae8c69e87d89fc61953f7241978d0958a82e24b. Measured parent: a2765d42438062db73d431ef6d296930e69f5b28.

PR source commit: 6e7759e970c0fe8c679e2fdc09a1dc8a20b1a6b6; mapped parent: da10665e5b0fad748a1e0e6550cc19880edd0317. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-01-io-wakeups to develop November 9, 2026 12:00
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-01-io-wakeups November 9, 2026 12:01
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6e7759e tpch-s3 1 Explore Profiling Data
🟢 Done 6e7759e tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 6e7759e tpch-nvme-10 1 Explore Profiling Data
🟢 Done 6e7759e tpch-nvme 1 Explore Profiling Data
🟢 Done 6e7759e fineweb 1 Explore Profiling Data
🟢 Done 6e7759e polarsignals 1 Explore Profiling Data
🟢 Done 6e7759e clickbench-nvme 1 Explore Profiling Data
🟢 Done 6e7759e tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 6e7759e9 vs base b2f8d0f9
Vortex (geomean): hot 1.032x ➖ · cold 1.007x ➖


datafusion / vortex-file-compressed / ns (1.032x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44143158 / 44247398 / -0.2% 88007817 / 86756764 / +1.4% 0.50 / 0.51 / -1.7%
polarsignals_q01/datafusion:vortex-file-compressed 70249204 / 53190033 / +32.1% 🔴 112457523 / 111620562 / +0.7% 0.62 / 0.48 / +31.1%
polarsignals_q02/datafusion:vortex-file-compressed 14573386 / 14308001 / +1.9% 45516021 / 50938846 / -10.6% 🟢 0.32 / 0.28 / +14.0%
polarsignals_q03/datafusion:vortex-file-compressed 69883784 / 69231543 / +0.9% 115023847 / 116022576 / -0.9% 0.61 / 0.60 / +1.8%
polarsignals_q04/datafusion:vortex-file-compressed 9033528 / 9324230 / -3.1% 42969604 / 43390473 / -1.0% 0.21 / 0.21 / -2.2%
polarsignals_q05/datafusion:vortex-file-compressed 11527922 / 11645938 / -1.0% 45163981 / 46740242 / -3.4% 0.26 / 0.25 / +2.4%
polarsignals_q06/datafusion:vortex-file-compressed 23022364 / 22759316 / +1.2% 56307013 / 56616878 / -0.5% 0.41 / 0.40 / +1.7%
polarsignals_q07/datafusion:vortex-file-compressed 10840121 / 10826504 / +0.1% 44176149 / 45422058 / -2.7% 0.25 / 0.24 / +2.9%
polarsignals_q08/datafusion:vortex-file-compressed 105018599 / 96763190 / +8.5% 158667567 / 161828007 / -2.0% 0.66 / 0.60 / +10.7%
polarsignals_q09/datafusion:vortex-file-compressed 9924747 / 9924556 / +0.0% 41736426 / 41195204 / +1.3% 0.24 / 0.24 / -1.3%
polarsignals_q10/datafusion:vortex-file-compressed 54642670 / 55401320 / -1.4% 150817493 / 116674031 / +29.3% 🔴 0.36 / 0.47 / -23.7%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 6e7759e9 vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.027x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.022x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21777285 / 21999911 / -1.0% 42073683 / 39946370 / +5.3% 0.52 / 0.55 / -6.0%
tpcds_q02/datafusion:vortex-file-compressed 43153728 / 42893253 / +0.6% 65277765 / 62914880 / +3.8% 0.66 / 0.68 / -3.0%
tpcds_q03/datafusion:vortex-file-compressed 11662271 / 11605178 / +0.5% 28905358 / 26609156 / +8.6% 0.40 / 0.44 / -7.5%
tpcds_q04/datafusion:vortex-file-compressed 79902868 / 78951654 / +1.2% 111938490 / 104564818 / +7.1% 0.71 / 0.76 / -5.5%
tpcds_q05/datafusion:vortex-file-compressed 56006998 / 55941465 / +0.1% 77032508 / 74124262 / +3.9% 0.73 / 0.75 / -3.7%
tpcds_q06/datafusion:vortex-file-compressed 21814526 / 21333720 / +2.3% 42275482 / 41069841 / +2.9% 0.52 / 0.52 / -0.7%
tpcds_q07/datafusion:vortex-file-compressed 26555228 / 26386390 / +0.6% 50600606 / 48176326 / +5.0% 0.52 / 0.55 / -4.2%
tpcds_q08/datafusion:vortex-file-compressed 26001708 / 25587712 / +1.6% 47047857 / 43682364 / +7.7% 0.55 / 0.59 / -5.7%
tpcds_q09/datafusion:vortex-file-compressed 20081791 / 19896226 / +0.9% 37581597 / 37474977 / +0.3% 0.53 / 0.53 / +0.6%
tpcds_q10/datafusion:vortex-file-compressed 28803494 / 29546889 / -2.5% 52219201 / 51180613 / +2.0% 0.55 / 0.58 / -4.5%
tpcds_q11/datafusion:vortex-file-compressed 48124736 / 49121194 / -2.0% 77329657 / 75394766 / +2.6% 0.62 / 0.65 / -4.5%
tpcds_q12/datafusion:vortex-file-compressed 15132838 / 14946749 / +1.2% 33382539 / 31749886 / +5.1% 0.45 / 0.47 / -3.7%
tpcds_q13/datafusion:vortex-file-compressed 30688492 / 31860550 / -3.7% 57795162 / 53865238 / +7.3% 0.53 / 0.59 / -10.2%
tpcds_q14/datafusion:vortex-file-compressed 488976594 / 487421370 / +0.3% 550573854 / 542474028 / +1.5% 0.89 / 0.90 / -1.2%
tpcds_q15/datafusion:vortex-file-compressed 12687422 / 12586756 / +0.8% 32929392 / 29869991 / +10.2% 🔴 0.39 / 0.42 / -8.6%
tpcds_q16/datafusion:vortex-file-compressed 19005290 / 18761618 / +1.3% 39032831 / 37089591 / +5.2% 0.49 / 0.51 / -3.7%
tpcds_q17/datafusion:vortex-file-compressed 53899621 / 53607682 / +0.5% 74068627 / 70072689 / +5.7% 0.73 / 0.77 / -4.9%
tpcds_q18/datafusion:vortex-file-compressed 63137347 / 62349632 / +1.3% 72552004 / 88633124 / -18.1% 🟢 0.87 / 0.70 / +23.7%
tpcds_q19/datafusion:vortex-file-compressed 16983488 / 17064877 / -0.5% 40201986 / 38137570 / +5.4% 0.42 / 0.45 / -5.6%
tpcds_q20/datafusion:vortex-file-compressed 16642196 / 16875604 / -1.4% 34427329 / 33398462 / +3.1% 0.48 / 0.51 / -4.3%
tpcds_q21/datafusion:vortex-file-compressed 15529474 / 14801170 / +4.9% 36415803 / 32973615 / +10.4% 🔴 0.43 / 0.45 / -5.0%
tpcds_q22/datafusion:vortex-file-compressed 48925646 / 49325762 / -0.8% 71579014 / 67699156 / +5.7% 0.68 / 0.73 / -6.2%
tpcds_q23/datafusion:vortex-file-compressed 72226804 / 72276124 / -0.1% 101845419 / 97272882 / +4.7% 0.71 / 0.74 / -4.6%
tpcds_q24/datafusion:vortex-file-compressed 64090844 / 63926868 / +0.3% 85890858 / 83129432 / +3.3% 0.75 / 0.77 / -3.0%
tpcds_q25/datafusion:vortex-file-compressed 45492815 / 44475855 / +2.3% 68957495 / 66779639 / +3.3% 0.66 / 0.67 / -0.9%
tpcds_q26/datafusion:vortex-file-compressed 26292522 / 26101808 / +0.7% 47508180 / 45977400 / +3.3% 0.55 / 0.57 / -2.5%
tpcds_q27/datafusion:vortex-file-compressed 51572632 / 53289153 / -3.2% 85561781 / 76338183 / +12.1% 🔴 0.60 / 0.70 / -13.7%
tpcds_q28/datafusion:vortex-file-compressed 20628198 / 19381416 / +6.4% 36144983 / 39922526 / -9.5% 0.57 / 0.49 / +17.6%
tpcds_q29/datafusion:vortex-file-compressed 52098402 / 52347589 / -0.5% 77683857 / 73566264 / +5.6% 0.67 / 0.71 / -5.8%
tpcds_q30/datafusion:vortex-file-compressed 27753583 / 27661427 / +0.3% 48260605 / 45075272 / +7.1% 0.58 / 0.61 / -6.3%
tpcds_q31/datafusion:vortex-file-compressed 63124404 / 62516696 / +1.0% 92203723 / 87634339 / +5.2% 0.68 / 0.71 / -4.0%
tpcds_q32/datafusion:vortex-file-compressed 13122845 / 13025350 / +0.7% 30813111 / 30062663 / +2.5% 0.43 / 0.43 / -1.7%
tpcds_q33/datafusion:vortex-file-compressed 28954310 / 27991706 / +3.4% 51361710 / 50078992 / +2.6% 0.56 / 0.56 / +0.9%
tpcds_q34/datafusion:vortex-file-compressed 17847365 / 17855906 / -0.0% 38034177 / 36650085 / +3.8% 0.47 / 0.49 / -3.7%
tpcds_q35/datafusion:vortex-file-compressed 30723284 / 31075584 / -1.1% 55514690 / 54010849 / +2.8% 0.55 / 0.58 / -3.8%
tpcds_q36/datafusion:vortex-file-compressed 47036638 / 46691248 / +0.7% 69616216 / 69134076 / +0.7% 0.68 / 0.68 / +0.0%
tpcds_q37/datafusion:vortex-file-compressed 12302655 / 12935278 / -4.9% 34169672 / 33965509 / +0.6% 0.36 / 0.38 / -5.5%
tpcds_q38/datafusion:vortex-file-compressed 25684706 / 26436550 / -2.8% 48199165 / 46500479 / +3.7% 0.53 / 0.57 / -6.3%
tpcds_q39/datafusion:vortex-file-compressed 64867034 / 64408856 / +0.7% 88067103 / 87056639 / +1.2% 0.74 / 0.74 / -0.4%
tpcds_q40/datafusion:vortex-file-compressed 22835022 / 22195258 / +2.9% 40269888 / 39059042 / +3.1% 0.57 / 0.57 / -0.2%
tpcds_q41/datafusion:vortex-file-compressed 20318489 / 20181415 / +0.7% 33481663 / 32305841 / +3.6% 0.61 / 0.62 / -2.9%
tpcds_q42/datafusion:vortex-file-compressed 11649221 / 11610268 / +0.3% 27779241 / 27549864 / +0.8% 0.42 / 0.42 / -0.5%
tpcds_q43/datafusion:vortex-file-compressed 13495108 / 13251107 / +1.8% 34867349 / 31511768 / +10.6% 🔴 0.39 / 0.42 / -8.0%
tpcds_q44/datafusion:vortex-file-compressed 27853862 / 27407222 / +1.6% 50343280 / 49901538 / +0.9% 0.55 / 0.55 / +0.7%
tpcds_q45/datafusion:vortex-file-compressed 17298418 / 17168016 / +0.8% 36038813 / 34200247 / +5.4% 0.48 / 0.50 / -4.4%
tpcds_q46/datafusion:vortex-file-compressed 23904128 / 23558210 / +1.5% 47989238 / 45525195 / +5.4% 0.50 / 0.52 / -3.7%
tpcds_q47/datafusion:vortex-file-compressed 75433862 / 75593490 / -0.2% 108208585 / 103395942 / +4.7% 0.70 / 0.73 / -4.6%
tpcds_q48/datafusion:vortex-file-compressed 28952786 / 28579330 / +1.3% 53732288 / 51250463 / +4.8% 0.54 / 0.56 / -3.4%
tpcds_q49/datafusion:vortex-file-compressed 56752629 / 57212074 / -0.8% 78480742 / 74563681 / +5.3% 0.72 / 0.77 / -5.8%
tpcds_q50/datafusion:vortex-file-compressed 31007048 / 31077502 / -0.2% 53573907 / 51768133 / +3.5% 0.58 / 0.60 / -3.6%
tpcds_q51/datafusion:vortex-file-compressed 66528978 / 67219460 / -1.0% 89759765 / 89984116 / -0.2% 0.74 / 0.75 / -0.8%
tpcds_q52/datafusion:vortex-file-compressed 11909760 / 11829058 / +0.7% 28260145 / 28624926 / -1.3% 0.42 / 0.41 / +2.0%
tpcds_q53/datafusion:vortex-file-compressed 18271817 / 18240894 / +0.2% 42260971 / 37934996 / +11.4% 🔴 0.43 / 0.48 / -10.1%
tpcds_q54/datafusion:vortex-file-compressed 32091782 / 32073801 / +0.1% 54379266 / 53625583 / +1.4% 0.59 / 0.60 / -1.3%
tpcds_q55/datafusion:vortex-file-compressed 11476396 / 11528832 / -0.5% 28403824 / 27437884 / +3.5% 0.40 / 0.42 / -3.8%
tpcds_q56/datafusion:vortex-file-compressed 26987299 / 26666916 / +1.2% 47932303 / 47448670 / +1.0% 0.56 / 0.56 / +0.2%
tpcds_q57/datafusion:vortex-file-compressed 62170362 / 62012122 / +0.3% 89505740 / 87267119 / +2.6% 0.69 / 0.71 / -2.3%
tpcds_q58/datafusion:vortex-file-compressed 40381570 / 40818922 / -1.1% 66640700 / 64518211 / +3.3% 0.61 / 0.63 / -4.2%
tpcds_q59/datafusion:vortex-file-compressed 27813638 / 27906409 / -0.3% 55829378 / 53781464 / +3.8% 0.50 / 0.52 / -4.0%
tpcds_q60/datafusion:vortex-file-compressed 26688414 / 27726237 / -3.7% 49601540 / 47532249 / +4.4% 0.54 / 0.58 / -7.8%
tpcds_q61/datafusion:vortex-file-compressed 20773112 / 20214066 / +2.8% 43865212 / 39682747 / +10.5% 🔴 0.47 / 0.51 / -7.0%
tpcds_q62/datafusion:vortex-file-compressed 16538246 / 16850174 / -1.9% 35931754 / 34396629 / +4.5% 0.46 / 0.49 / -6.0%
tpcds_q63/datafusion:vortex-file-compressed 18258273 / 18192128 / +0.4% 41054732 / 37641254 / +9.1% 0.44 / 0.48 / -8.0%
tpcds_q64/datafusion:vortex-file-compressed 187631332 / 188561892 / -0.5% 221872411 / 229680212 / -3.4% 0.85 / 0.82 / +3.0%
tpcds_q65/datafusion:vortex-file-compressed 74571546 / 73066724 / +2.1% 98063072 / 96562612 / +1.6% 0.76 / 0.76 / +0.5%
tpcds_q66/datafusion:vortex-file-compressed 50380163 / 50096568 / +0.6% 72204786 / 69306342 / +4.2% 0.70 / 0.72 / -3.5%
tpcds_q67/datafusion:vortex-file-compressed 51123524 / 51663640 / -1.0% 85021023 / 83492505 / +1.8% 0.60 / 0.62 / -2.8%
tpcds_q68/datafusion:vortex-file-compressed 22804560 / 22888054 / -0.4% 47475186 / 44101071 / +7.7% 0.48 / 0.52 / -7.4%
tpcds_q69/datafusion:vortex-file-compressed 27443050 / 27546142 / -0.4% 49035927 / 47372016 / +3.5% 0.56 / 0.58 / -3.8%
tpcds_q70/datafusion:vortex-file-compressed 74275864 / 73486667 / +1.1% 97554704 / 97916702 / -0.4% 0.76 / 0.75 / +1.4%
tpcds_q71/datafusion:vortex-file-compressed 18476900 / 19173117 / -3.6% 39984446 / 37641700 / +6.2% 0.46 / 0.51 / -9.3%
tpcds_q72/datafusion:vortex-file-compressed 270259475 / 247376824 / +9.3% 282636952 / 279389691 / +1.2% 0.96 / 0.89 / +8.0%
tpcds_q73/datafusion:vortex-file-compressed 16656618 / 16283788 / +2.3% 38556733 / 37287301 / +3.4% 0.43 / 0.44 / -1.1%
tpcds_q74/datafusion:vortex-file-compressed 40490690 / 40826743 / -0.8% 69240969 / 66742487 / +3.7% 0.58 / 0.61 / -4.4%
tpcds_q75/datafusion:vortex-file-compressed 136223758 / 133968630 / +1.7% 165512090 / 162666038 / +1.7% 0.82 / 0.82 / -0.1%
tpcds_q76/datafusion:vortex-file-compressed 29550144 / 28638050 / +3.2% 48440216 / 48545831 / -0.2% 0.61 / 0.59 / +3.4%
tpcds_q77/datafusion:vortex-file-compressed 45734716 / 44422120 / +3.0% 68473362 / 65708594 / +4.2% 0.67 / 0.68 / -1.2%
tpcds_q78/datafusion:vortex-file-compressed 60246852 / 60965657 / -1.2% 90869668 / 86015972 / +5.6% 0.66 / 0.71 / -6.5%
tpcds_q79/datafusion:vortex-file-compressed 20080336 / 20279438 / -1.0% 42433152 / 42110377 / +0.8% 0.47 / 0.48 / -1.7%
tpcds_q80/datafusion:vortex-file-compressed 68631072 / 68766030 / -0.2% 95960085 / 93570722 / +2.6% 0.72 / 0.73 / -2.7%
tpcds_q81/datafusion:vortex-file-compressed 28407566 / 28260648 / +0.5% 47698423 / 45300560 / +5.3% 0.60 / 0.62 / -4.5%
tpcds_q82/datafusion:vortex-file-compressed 12720824 / 12807434 / -0.7% 35828801 / 35626130 / +0.6% 0.36 / 0.36 / -1.2%
tpcds_q83/datafusion:vortex-file-compressed 34697853 / 35376074 / -1.9% 55821785 / 52093141 / +7.2% 0.62 / 0.68 / -8.5%
tpcds_q84/datafusion:vortex-file-compressed 10827986 / 10461540 / +3.5% 26967512 / 25885722 / +4.2% 0.40 / 0.40 / -0.6%
tpcds_q85/datafusion:vortex-file-compressed 51615582 / 51809666 / -0.4% 78506752 / 75574697 / +3.9% 0.66 / 0.69 / -4.1%
tpcds_q86/datafusion:vortex-file-compressed 16136836 / 16113415 / +0.1% 35874227 / 34409002 / +4.3% 0.45 / 0.47 / -3.9%
tpcds_q87/datafusion:vortex-file-compressed 26752917 / 26499568 / +1.0% 49944857 / 48598250 / +2.8% 0.54 / 0.55 / -1.8%
tpcds_q88/datafusion:vortex-file-compressed 32811574 / 32357568 / +1.4% 53978211 / 50858837 / +6.1% 0.61 / 0.64 / -4.5%
tpcds_q89/datafusion:vortex-file-compressed 21505743 / 21807304 / -1.4% 45046172 / 42407282 / +6.2% 0.48 / 0.51 / -7.2%
tpcds_q90/datafusion:vortex-file-compressed 10304094 / 10365216 / -0.6% 26142433 / 24066050 / +8.6% 0.39 / 0.43 / -8.5%
tpcds_q91/datafusion:vortex-file-compressed 16181218 / 16048840 / +0.8% 38138435 / 36604324 / +4.2% 0.42 / 0.44 / -3.2%
tpcds_q92/datafusion:vortex-file-compressed 12991579 / 13198902 / -1.6% 31652373 / 29685220 / +6.6% 0.41 / 0.44 / -7.7%
tpcds_q93/datafusion:vortex-file-compressed 20324766 / 20150414 / +0.9% 41304657 / 40148939 / +2.9% 0.49 / 0.50 / -2.0%
tpcds_q94/datafusion:vortex-file-compressed 18830541 / 18552985 / +1.5% 39273161 / 37927246 / +3.5% 0.48 / 0.49 / -2.0%
tpcds_q95/datafusion:vortex-file-compressed 42338404 / 41763500 / +1.4% 64392188 / 60866535 / +5.8% 0.66 / 0.69 / -4.2%
tpcds_q96/datafusion:vortex-file-compressed 7813111 / 7859994 / -0.6% 25248672 / 23576532 / +7.1% 0.31 / 0.33 / -7.2%
tpcds_q97/datafusion:vortex-file-compressed 17265538 / 17259486 / +0.0% 40072447 / 37350276 / +7.3% 0.43 / 0.46 / -6.8%
tpcds_q98/datafusion:vortex-file-compressed 16023466 / 16185816 / -1.0% 36438441 / 32671739 / +11.5% 🔴 0.44 / 0.50 / -11.2%
tpcds_q99/datafusion:vortex-file-compressed 16342886 / 16384194 / -0.3% 34945666 / 33993322 / +2.8% 0.47 / 0.48 / -3.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42939480 / 43046149 / -0.2% 58611056 / 59333915 / -1.2% 0.73 / 0.73 / +1.0%
tpcds_q02/datafusion:parquet 54971169 / 55017496 / -0.1% 70670313 / 69006470 / +2.4% 0.78 / 0.80 / -2.4%
tpcds_q03/datafusion:parquet 18902716 / 19078092 / -0.9% 33439157 / 32968281 / +1.4% 0.57 / 0.58 / -2.3%
tpcds_q04/datafusion:parquet 179344010 / 179731768 / -0.2% 205059863 / 199226926 / +2.9% 0.87 / 0.90 / -3.1%
tpcds_q05/datafusion:parquet 67662220 / 68363662 / -1.0% 87935566 / 88310082 / -0.4% 0.77 / 0.77 / -0.6%
tpcds_q06/datafusion:parquet 34087948 / 35133400 / -3.0% 47736078 / 44032369 / +8.4% 0.71 / 0.80 / -10.5%
tpcds_q07/datafusion:parquet 47073974 / 47015244 / +0.1% 65174438 / 63060866 / +3.4% 0.72 / 0.75 / -3.1%
tpcds_q08/datafusion:parquet 31247906 / 31108916 / +0.4% 47836226 / 46407336 / +3.1% 0.65 / 0.67 / -2.6%
tpcds_q09/datafusion:parquet 34748950 / 32235404 / +7.8% 47675099 / 38162448 / +24.9% 🔴 0.73 / 0.84 / -13.7%
tpcds_q10/datafusion:parquet 43598412 / 45810956 / -4.8% 60648524 / 55821116 / +8.6% 0.72 / 0.82 / -12.4%
tpcds_q11/datafusion:parquet 97932242 / 97324552 / +0.6% 117954136 / 116986930 / +0.8% 0.83 / 0.83 / -0.2%
tpcds_q12/datafusion:parquet 23980971 / 23829389 / +0.6% 35375464 / 34561700 / +2.4% 0.68 / 0.69 / -1.7%
tpcds_q13/datafusion:parquet 46304068 / 47205746 / -1.9% 68395959 / 66519722 / +2.8% 0.68 / 0.71 / -4.6%
tpcds_q14/datafusion:parquet 533786127 / 536062596 / -0.4% 581993316 / 573875357 / +1.4% 0.92 / 0.93 / -1.8%
tpcds_q15/datafusion:parquet 23762408 / 23467316 / +1.3% 37524904 / 36912696 / +1.7% 0.63 / 0.64 / -0.4%
tpcds_q16/datafusion:parquet 37020496 / 36797934 / +0.6% 49674908 / 49093338 / +1.2% 0.75 / 0.75 / -0.6%
tpcds_q17/datafusion:parquet 74679040 / 77417738 / -3.5% 95446190 / 94152957 / +1.4% 0.78 / 0.82 / -4.8%
tpcds_q18/datafusion:parquet 65662994 / 67730459 / -3.1% 87885081 / 89015478 / -1.3% 0.75 / 0.76 / -1.8%
tpcds_q19/datafusion:parquet 29703732 / 29767255 / -0.2% 41579291 / 40859608 / +1.8% 0.71 / 0.73 / -1.9%
tpcds_q20/datafusion:parquet 24985394 / 24985466 / -0.0% 36622590 / 37149008 / -1.4% 0.68 / 0.67 / +1.4%
tpcds_q21/datafusion:parquet 20213665 / 20098942 / +0.6% 32158536 / 31199048 / +3.1% 0.63 / 0.64 / -2.4%
tpcds_q22/datafusion:parquet 77148974 / 78225004 / -1.4% 88527021 / 88011450 / +0.6% 0.87 / 0.89 / -1.9%
tpcds_q23/datafusion:parquet 91995752 / 93465786 / -1.6% 112691912 / 115763272 / -2.7% 0.82 / 0.81 / +1.1%
tpcds_q24/datafusion:parquet 90728924 / 90530880 / +0.2% 115494005 / 112774834 / +2.4% 0.79 / 0.80 / -2.1%
tpcds_q25/datafusion:parquet 80197704 / 78942378 / +1.6% 100094241 / 100286343 / -0.2% 0.80 / 0.79 / +1.8%
tpcds_q26/datafusion:parquet 43148812 / 42985690 / +0.4% 58117243 / 59286646 / -2.0% 0.74 / 0.73 / +2.4%
tpcds_q27/datafusion:parquet 77236588 / 78387144 / -1.5% 99327892 / 99975873 / -0.6% 0.78 / 0.78 / -0.8%
tpcds_q28/datafusion:parquet 28508514 / 28355490 / +0.5% 42478119 / 41055918 / +3.5% 0.67 / 0.69 / -2.8%
tpcds_q29/datafusion:parquet 74717754 / 74275574 / +0.6% 99404908 / 99075419 / +0.3% 0.75 / 0.75 / +0.3%
tpcds_q30/datafusion:parquet 45948360 / 44266542 / +3.8% 58593340 / 55134805 / +6.3% 0.78 / 0.80 / -2.3%
tpcds_q31/datafusion:parquet 80921758 / 80991932 / -0.1% 100264354 / 100088488 / +0.2% 0.81 / 0.81 / -0.3%
tpcds_q32/datafusion:parquet 26944389 / 27160338 / -0.8% 40428752 / 37888363 / +6.7% 0.67 / 0.72 / -7.0%
tpcds_q33/datafusion:parquet 37905669 / 37472210 / +1.2% 53426466 / 52784833 / +1.2% 0.71 / 0.71 / -0.1%
tpcds_q34/datafusion:parquet 24315074 / 24223199 / +0.4% 35575390 / 34925847 / +1.9% 0.68 / 0.69 / -1.5%
tpcds_q35/datafusion:parquet 50856600 / 50061658 / +1.6% 66879754 / 66186392 / +1.0% 0.76 / 0.76 / +0.5%
tpcds_q36/datafusion:parquet 52850326 / 53863620 / -1.9% 71049615 / 72008538 / -1.3% 0.74 / 0.75 / -0.6%
tpcds_q37/datafusion:parquet 21382284 / 21492292 / -0.5% 33968155 / 33965178 / +0.0% 0.63 / 0.63 / -0.5%
tpcds_q38/datafusion:parquet 44995530 / 43738358 / +2.9% 59665902 / 58984516 / +1.2% 0.75 / 0.74 / +1.7%
tpcds_q39/datafusion:parquet 67780078 / 68451454 / -1.0% 85334717 / 84694449 / +0.8% 0.79 / 0.81 / -1.7%
tpcds_q40/datafusion:parquet 30419682 / 29898065 / +1.7% 49616184 / 49416081 / +0.4% 0.61 / 0.61 / +1.3%
tpcds_q41/datafusion:parquet 20047824 / 19725044 / +1.6% 32689807 / 31567276 / +3.6% 0.61 / 0.62 / -1.9%
tpcds_q42/datafusion:parquet 18130658 / 18410036 / -1.5% 30047439 / 29096386 / +3.3% 0.60 / 0.63 / -4.6%
tpcds_q43/datafusion:parquet 19504226 / 19482850 / +0.1% 32364423 / 30496940 / +6.1% 0.60 / 0.64 / -5.7%
tpcds_q44/datafusion:parquet 35211860 / 35289568 / -0.2% 48531060 / 48402674 / +0.3% 0.73 / 0.73 / -0.5%
tpcds_q45/datafusion:parquet 27798016 / 28034722 / -0.8% 39628009 / 38421721 / +3.1% 0.70 / 0.73 / -3.9%
tpcds_q46/datafusion:parquet 28854138 / 29018574 / -0.6% 46068751 / 44678861 / +3.1% 0.63 / 0.65 / -3.6%
tpcds_q47/datafusion:parquet 96796834 / 96614053 / +0.2% 121178241 / 119575121 / +1.3% 0.80 / 0.81 / -1.1%
tpcds_q48/datafusion:parquet 42372048 / 42307228 / +0.2% 60195557 / 57749935 / +4.2% 0.70 / 0.73 / -3.9%
tpcds_q49/datafusion:parquet 72257586 / 72427164 / -0.2% 94077866 / 91585118 / +2.7% 0.77 / 0.79 / -2.9%
tpcds_q50/datafusion:parquet 47067554 / 47500422 / -0.9% 66916606 / 68227695 / -1.9% 0.70 / 0.70 / +1.0%
tpcds_q51/datafusion:parquet 75907608 / 74856850 / +1.4% 95076519 / 94480088 / +0.6% 0.80 / 0.79 / +0.8%
tpcds_q52/datafusion:parquet 18272946 / 18570137 / -1.6% 30916478 / 28281276 / +9.3% 0.59 / 0.66 / -10.0%
tpcds_q53/datafusion:parquet 22311276 / 21996628 / +1.4% 38921543 / 37632392 / +3.4% 0.57 / 0.58 / -1.9%
tpcds_q54/datafusion:parquet 53929831 / 53403201 / +1.0% 65599393 / 65412957 / +0.3% 0.82 / 0.82 / +0.7%
tpcds_q55/datafusion:parquet 18135000 / 18094322 / +0.2% 30812692 / 28452535 / +8.3% 0.59 / 0.64 / -7.5%
tpcds_q56/datafusion:parquet 40932026 / 42064521 / -2.7% 58732261 / 52494093 / +11.9% 🔴 0.70 / 0.80 / -13.0%
tpcds_q57/datafusion:parquet 101021343 / 98531152 / +2.5% 118494305 / 115051750 / +3.0% 0.85 / 0.86 / -0.5%
tpcds_q58/datafusion:parquet 65394934 / 66028114 / -1.0% 82398172 / 80484923 / +2.4% 0.79 / 0.82 / -3.3%
tpcds_q59/datafusion:parquet 47323200 / 48124550 / -1.7% 63718894 / 63375622 / +0.5% 0.74 / 0.76 / -2.2%
tpcds_q60/datafusion:parquet 40226742 / 41774428 / -3.7% 52702828 / 52913053 / -0.4% 0.76 / 0.79 / -3.3%
tpcds_q61/datafusion:parquet 36714382 / 36568854 / +0.4% 51944042 / 53842276 / -3.5% 0.71 / 0.68 / +4.1%
tpcds_q62/datafusion:parquet 25118920 / 25168784 / -0.2% 38067224 / 38657488 / -1.5% 0.66 / 0.65 / +1.3%
tpcds_q63/datafusion:parquet 22295444 / 22467320 / -0.8% 38342288 / 36224907 / +5.8% 0.58 / 0.62 / -6.2%
tpcds_q64/datafusion:parquet 285711722 / 285654170 / +0.0% 322631233 / 321241476 / +0.4% 0.89 / 0.89 / -0.4%
tpcds_q65/datafusion:parquet 120650916 / 119227688 / +1.2% 139658072 / 139579808 / +0.1% 0.86 / 0.85 / +1.1%
tpcds_q66/datafusion:parquet 60116782 / 61287888 / -1.9% 77459933 / 75163315 / +3.1% 0.78 / 0.82 / -4.8%
tpcds_q67/datafusion:parquet 69163695 / 69044428 / +0.2% 92637130 / 91696967 / +1.0% 0.75 / 0.75 / -0.8%
tpcds_q68/datafusion:parquet 28775431 / 29075160 / -1.0% 47508086 / 47405672 / +0.2% 0.61 / 0.61 / -1.2%
tpcds_q69/datafusion:parquet 44462028 / 43304174 / +2.7% 56411492 / 58652073 / -3.8% 0.79 / 0.74 / +6.8%
tpcds_q70/datafusion:parquet 80626043 / 80027439 / +0.7% 98096957 / 97604918 / +0.5% 0.82 / 0.82 / +0.2%
tpcds_q71/datafusion:parquet 24826639 / 25732466 / -3.5% 38058860 / 40528677 / -6.1% 0.65 / 0.63 / +2.7%
tpcds_q72/datafusion:parquet 520098057 / 527634840 / -1.4% 548527407 / 554349016 / -1.1% 0.95 / 0.95 / -0.4%
tpcds_q73/datafusion:parquet 23908818 / 23762050 / +0.6% 36789605 / 35077300 / +4.9% 0.65 / 0.68 / -4.1%
tpcds_q74/datafusion:parquet 69935123 / 69999536 / -0.1% 88234673 / 88289509 / -0.1% 0.79 / 0.79 / -0.0%
tpcds_q75/datafusion:parquet 153071678 / 152662930 / +0.3% 175500159 / 180450074 / -2.7% 0.87 / 0.85 / +3.1%
tpcds_q76/datafusion:parquet 34040911 / 33132911 / +2.7% 47218142 / 44935481 / +5.1% 0.72 / 0.74 / -2.2%
tpcds_q77/datafusion:parquet 56989944 / 56979256 / +0.0% 75118277 / 72969812 / +2.9% 0.76 / 0.78 / -2.8%
tpcds_q78/datafusion:parquet 86197177 / 85272162 / +1.1% 120076555 / 115614404 / +3.9% 0.72 / 0.74 / -2.7%
tpcds_q79/datafusion:parquet 26563790 / 26735792 / -0.6% 42694282 / 39769716 / +7.4% 0.62 / 0.67 / -7.4%
tpcds_q80/datafusion:parquet 81378802 / 78680880 / +3.4% 111136762 / 107863155 / +3.0% 0.73 / 0.73 / +0.4%
tpcds_q81/datafusion:parquet 36634313 / 39558134 / -7.4% 55517095 / 51081109 / +8.7% 0.66 / 0.77 / -14.8%
tpcds_q82/datafusion:parquet 22670056 / 22190428 / +2.2% 34828873 / 34291795 / +1.6% 0.65 / 0.65 / +0.6%
tpcds_q83/datafusion:parquet 58185744 / 58307740 / -0.2% 71973566 / 73002134 / -1.4% 0.81 / 0.80 / +1.2%
tpcds_q84/datafusion:parquet 27498350 / 27313596 / +0.7% 41870956 / 40041516 / +4.6% 0.66 / 0.68 / -3.7%
tpcds_q85/datafusion:parquet 80268503 / 79983598 / +0.4% 103961434 / 102306985 / +1.6% 0.77 / 0.78 / -1.2%
tpcds_q86/datafusion:parquet 20981744 / 21058438 / -0.4% 33286936 / 32574181 / +2.2% 0.63 / 0.65 / -2.5%
tpcds_q87/datafusion:parquet 44959504 / 45280914 / -0.7% 59463120 / 62384128 / -4.7% 0.76 / 0.73 / +4.2%
tpcds_q88/datafusion:parquet 37771978 / 37757294 / +0.0% 53685557 / 51820809 / +3.6% 0.70 / 0.73 / -3.4%
tpcds_q89/datafusion:parquet 25642793 / 26318301 / -2.6% 42658215 / 39991728 / +6.7% 0.60 / 0.66 / -8.7%
tpcds_q90/datafusion:parquet 16200968 / 15087966 / +7.4% 28064161 / 26597960 / +5.5% 0.58 / 0.57 / +1.8%
tpcds_q91/datafusion:parquet 31802661 / 32625398 / -2.5% 50661626 / 45196471 / +12.1% 🔴 0.63 / 0.72 / -13.0%
tpcds_q92/datafusion:parquet 26853992 / 26834922 / +0.1% 40447165 / 38063167 / +6.3% 0.66 / 0.71 / -5.8%
tpcds_q93/datafusion:parquet 26963715 / 26735974 / +0.9% 47801333 / 42486273 / +12.5% 🔴 0.56 / 0.63 / -10.4%
tpcds_q94/datafusion:parquet 35168474 / 35393988 / -0.6% 49385342 / 47118664 / +4.8% 0.71 / 0.75 / -5.2%
tpcds_q95/datafusion:parquet 64601546 / 64212454 / +0.6% 79804312 / 79492966 / +0.4% 0.81 / 0.81 / +0.2%
tpcds_q96/datafusion:parquet 12977064 / 12723054 / +2.0% 24309183 / 23429883 / +3.8% 0.53 / 0.54 / -1.7%
tpcds_q97/datafusion:parquet 35559494 / 35098156 / +1.3% 51000060 / 49335860 / +3.4% 0.70 / 0.71 / -2.0%
tpcds_q98/datafusion:parquet 25470906 / 25139323 / +1.3% 39038868 / 36349537 / +7.4% 0.65 / 0.69 / -5.7%
tpcds_q99/datafusion:parquet 29662526 / 29673968 / -0.0% 41636813 / 41366470 / +0.7% 0.71 / 0.72 / -0.7%
duckdb / vortex-file-compressed / ns (1.003x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16289656 / 15890239 / +2.5% 24325354 / 24196641 / +0.5% 0.67 / 0.66 / +2.0%
tpcds_q02/duckdb:vortex-file-compressed 16364044 / 18657920 / -12.3% 🟢 22395637 / 22422968 / -0.1% 0.73 / 0.83 / -12.2%
tpcds_q03/duckdb:vortex-file-compressed 7106118 / 7149274 / -0.6% 17167323 / 16220757 / +5.8% 0.41 / 0.44 / -6.1%
tpcds_q04/duckdb:vortex-file-compressed 58985814 / 58862208 / +0.2% 72222242 / 71856038 / +0.5% 0.82 / 0.82 / -0.3%
tpcds_q05/duckdb:vortex-file-compressed 22805906 / 23117854 / -1.3% 31527303 / 32942130 / -4.3% 0.72 / 0.70 / +3.1%
tpcds_q06/duckdb:vortex-file-compressed 24178534 / 24164680 / +0.1% 38365093 / 37874428 / +1.3% 0.63 / 0.64 / -1.2%
tpcds_q07/duckdb:vortex-file-compressed 22225682 / 22109802 / +0.5% 34881270 / 32504438 / +7.3% 0.64 / 0.68 / -6.3%
tpcds_q08/duckdb:vortex-file-compressed 17422331 / 17492722 / -0.4% 25547890 / 25089879 / +1.8% 0.68 / 0.70 / -2.2%
tpcds_q09/duckdb:vortex-file-compressed 18952826 / 19005454 / -0.3% 30062742 / 29541405 / +1.8% 0.63 / 0.64 / -2.0%
tpcds_q10/duckdb:vortex-file-compressed 27633404 / 27533383 / +0.4% 41286805 / 41135181 / +0.4% 0.67 / 0.67 / -0.0%
tpcds_q11/duckdb:vortex-file-compressed 36468963 / 36618646 / -0.4% 45162239 / 44343100 / +1.8% 0.81 / 0.83 / -2.2%
tpcds_q12/duckdb:vortex-file-compressed 9804803 / 9679752 / +1.3% 16827684 / 17229625 / -2.3% 0.58 / 0.56 / +3.7%
tpcds_q13/duckdb:vortex-file-compressed 19639286 / 19843352 / -1.0% 33409387 / 31995768 / +4.4% 0.59 / 0.62 / -5.2%
tpcds_q14/duckdb:vortex-file-compressed 55758214 / 55297112 / +0.8% 64659752 / 64955646 / -0.5% 0.86 / 0.85 / +1.3%
tpcds_q15/duckdb:vortex-file-compressed 11246844 / 11325009 / -0.7% 18427453 / 18325444 / +0.6% 0.61 / 0.62 / -1.2%
tpcds_q16/duckdb:vortex-file-compressed 24959134 / 24731064 / +0.9% 35323204 / 34853379 / +1.3% 0.71 / 0.71 / -0.4%
tpcds_q17/duckdb:vortex-file-compressed 20638378 / 20396798 / +1.2% 33337551 / 32338231 / +3.1% 0.62 / 0.63 / -1.8%
tpcds_q18/duckdb:vortex-file-compressed 32109072 / 32346349 / -0.7% 44316512 / 43278488 / +2.4% 0.72 / 0.75 / -3.1%
tpcds_q19/duckdb:vortex-file-compressed 20893436 / 20786617 / +0.5% 30651381 / 29101806 / +5.3% 0.68 / 0.71 / -4.6%
tpcds_q20/duckdb:vortex-file-compressed 10576614 / 10704608 / -1.2% 17885585 / 17476285 / +2.3% 0.59 / 0.61 / -3.5%
tpcds_q21/duckdb:vortex-file-compressed 9224656 / 9371898 / -1.6% 22927503 / 21703364 / +5.6% 0.40 / 0.43 / -6.8%
tpcds_q22/duckdb:vortex-file-compressed 17794671 / 17643249 / +0.9% 30487483 / 29161310 / +4.5% 0.58 / 0.61 / -3.5%
tpcds_q23/duckdb:vortex-file-compressed 37479388 / 37431455 / +0.1% 51074794 / 48459168 / +5.4% 0.73 / 0.77 / -5.0%
tpcds_q24/duckdb:vortex-file-compressed 26481408 / 26441519 / +0.2% 39240533 / 36595428 / +7.2% 0.67 / 0.72 / -6.6%
tpcds_q25/duckdb:vortex-file-compressed 19520602 / 19221668 / +1.6% 32317837 / 30221864 / +6.9% 0.60 / 0.64 / -5.0%
tpcds_q26/duckdb:vortex-file-compressed 21670584 / 21300105 / +1.7% 33096666 / 31212707 / +6.0% 0.65 / 0.68 / -4.1%
tpcds_q27/duckdb:vortex-file-compressed 25102378 / 24807916 / +1.2% 36650015 / 35637087 / +2.8% 0.68 / 0.70 / -1.6%
tpcds_q28/duckdb:vortex-file-compressed 15209063 / 15090790 / +0.8% 25328764 / 25912108 / -2.3% 0.60 / 0.58 / +3.1%
tpcds_q29/duckdb:vortex-file-compressed 18898656 / 18678136 / +1.2% 30194556 / 29174081 / +3.5% 0.63 / 0.64 / -2.2%
tpcds_q30/duckdb:vortex-file-compressed 18672842 / 18682425 / -0.1% 27288670 / 27172488 / +0.4% 0.68 / 0.69 / -0.5%
tpcds_q31/duckdb:vortex-file-compressed 17964118 / 17961668 / +0.0% 26702525 / 26844104 / -0.5% 0.67 / 0.67 / +0.5%
tpcds_q32/duckdb:vortex-file-compressed 10411532 / 10237077 / +1.7% 18015560 / 18081369 / -0.4% 0.58 / 0.57 / +2.1%
tpcds_q33/duckdb:vortex-file-compressed 17913212 / 17651904 / +1.5% 27658005 / 27599437 / +0.2% 0.65 / 0.64 / +1.3%
tpcds_q34/duckdb:vortex-file-compressed 13157252 / 12881700 / +2.1% 23396484 / 21645185 / +8.1% 0.56 / 0.60 / -5.5%
tpcds_q35/duckdb:vortex-file-compressed 31079216 / 31119364 / -0.1% 44624724 / 42566508 / +4.8% 0.70 / 0.73 / -4.7%
tpcds_q36/duckdb:vortex-file-compressed 14224921 / 14037150 / +1.3% 24776110 / 23560362 / +5.2% 0.57 / 0.60 / -3.6%
tpcds_q37/duckdb:vortex-file-compressed 9310734 / 9278629 / +0.3% 24184330 / 24238961 / -0.2% 0.38 / 0.38 / +0.6%
tpcds_q38/duckdb:vortex-file-compressed 24402528 / 24606434 / -0.8% 32218164 / 31179343 / +3.3% 0.76 / 0.79 / -4.0%
tpcds_q39/duckdb:vortex-file-compressed 18417881 / 18495272 / -0.4% 32203503 / 30737214 / +4.8% 0.57 / 0.60 / -5.0%
tpcds_q40/duckdb:vortex-file-compressed 11223692 / 11167876 / +0.5% 19726085 / 19316090 / +2.1% 0.57 / 0.58 / -1.6%
tpcds_q41/duckdb:vortex-file-compressed 17530572 / 17305600 / +1.3% 23572327 / 24395246 / -3.4% 0.74 / 0.71 / +4.8%
tpcds_q42/duckdb:vortex-file-compressed 7054682 / 6914912 / +2.0% 15992468 / 15064464 / +6.2% 0.44 / 0.46 / -3.9%
tpcds_q43/duckdb:vortex-file-compressed 9718778 / 9643249 / +0.8% 19686022 / 18160250 / +8.4% 0.49 / 0.53 / -7.0%
tpcds_q44/duckdb:vortex-file-compressed 12589045 / 12476409 / +0.9% 24209771 / 23821756 / +1.6% 0.52 / 0.52 / -0.7%
tpcds_q45/duckdb:vortex-file-compressed 23705430 / 23587638 / +0.5% 30339164 / 30430270 / -0.3% 0.78 / 0.78 / +0.8%
tpcds_q46/duckdb:vortex-file-compressed 31986398 / 31418024 / +1.8% 44665749 / 43171545 / +3.5% 0.72 / 0.73 / -1.6%
tpcds_q47/duckdb:vortex-file-compressed 30837474 / 31264494 / -1.4% 40805376 / 41141020 / -0.8% 0.76 / 0.76 / -0.6%
tpcds_q48/duckdb:vortex-file-compressed 22839331 / 22472531 / +1.6% 36065260 / 35469142 / +1.7% 0.63 / 0.63 / -0.0%
tpcds_q49/duckdb:vortex-file-compressed 18671696 / 18985566 / -1.7% 30741374 / 29722088 / +3.4% 0.61 / 0.64 / -4.9%
tpcds_q50/duckdb:vortex-file-compressed 14860626 / 14896845 / -0.2% 26494309 / 25687406 / +3.1% 0.56 / 0.58 / -3.3%
tpcds_q51/duckdb:vortex-file-compressed 49227860 / 48063878 / +2.4% 58115267 / 76334322 / -23.9% 🟢 0.85 / 0.63 / +34.5%
tpcds_q52/duckdb:vortex-file-compressed 7042262 / 7171716 / -1.8% 16171254 / 15978547 / +1.2% 0.44 / 0.45 / -3.0%
tpcds_q53/duckdb:vortex-file-compressed 11511678 / 11319189 / +1.7% 20213717 / 21681207 / -6.8% 0.57 / 0.52 / +9.1%
tpcds_q54/duckdb:vortex-file-compressed 19515320 / 19748759 / -1.2% 30497459 / 29438540 / +3.6% 0.64 / 0.67 / -4.6%
tpcds_q55/duckdb:vortex-file-compressed 6956614 / 6847788 / +1.6% 16079869 / 15285422 / +5.2% 0.43 / 0.45 / -3.4%
tpcds_q56/duckdb:vortex-file-compressed 17954790 / 17817582 / +0.8% 28369880 / 28613711 / -0.9% 0.63 / 0.62 / +1.6%
tpcds_q57/duckdb:vortex-file-compressed 25875174 / 25308086 / +2.2% 34992711 / 33487780 / +4.5% 0.74 / 0.76 / -2.2%
tpcds_q58/duckdb:vortex-file-compressed 20360801 / 20359384 / +0.0% 29363938 / 29241349 / +0.4% 0.69 / 0.70 / -0.4%
tpcds_q59/duckdb:vortex-file-compressed 19517576 / 19485481 / +0.2% 27559389 / 26442217 / +4.2% 0.71 / 0.74 / -3.9%
tpcds_q60/duckdb:vortex-file-compressed 18435324 / 18504610 / -0.4% 28764525 / 28842068 / -0.3% 0.64 / 0.64 / -0.1%
tpcds_q61/duckdb:vortex-file-compressed 19912152 / 19922872 / -0.1% 30739928 / 30039600 / +2.3% 0.65 / 0.66 / -2.3%
tpcds_q62/duckdb:vortex-file-compressed 11039412 / 10937722 / +0.9% 17328279 / 17144486 / +1.1% 0.64 / 0.64 / -0.1%
tpcds_q63/duckdb:vortex-file-compressed 10955733 / 10809960 / +1.3% 19975147 / 20560158 / -2.8% 0.55 / 0.53 / +4.3%
tpcds_q64/duckdb:vortex-file-compressed 52823560 / 52513062 / +0.6% 69985634 / 68406502 / +2.3% 0.75 / 0.77 / -1.7%
tpcds_q65/duckdb:vortex-file-compressed 13145043 / 13060742 / +0.6% 23161804 / 23236608 / -0.3% 0.57 / 0.56 / +1.0%
tpcds_q66/duckdb:vortex-file-compressed 31337511 / 31272590 / +0.2% 39418724 / 39351988 / +0.2% 0.79 / 0.79 / +0.0%
tpcds_q67/duckdb:vortex-file-compressed 55565652 / 55266268 / +0.5% 66236146 / 64683896 / +2.4% 0.84 / 0.85 / -1.8%
tpcds_q68/duckdb:vortex-file-compressed 22769426 / 23009998 / -1.0% 36442741 / 35296552 / +3.2% 0.62 / 0.65 / -4.2%
tpcds_q69/duckdb:vortex-file-compressed 22121898 / 22017648 / +0.5% 38080177 / 36691775 / +3.8% 0.58 / 0.60 / -3.2%
tpcds_q70/duckdb:vortex-file-compressed 14659363 / 14724129 / -0.4% 25091407 / 25052861 / +0.2% 0.58 / 0.59 / -0.6%
tpcds_q71/duckdb:vortex-file-compressed 13515192 / 13347567 / +1.3% 24550415 / 23409485 / +4.9% 0.55 / 0.57 / -3.4%
tpcds_q72/duckdb:vortex-file-compressed 43079374 / 43060600 / +0.0% 56561734 / 56269909 / +0.5% 0.76 / 0.77 / -0.5%
tpcds_q73/duckdb:vortex-file-compressed 11966841 / 11829364 / +1.2% 21272166 / 21106781 / +0.8% 0.56 / 0.56 / +0.4%
tpcds_q74/duckdb:vortex-file-compressed 30836900 / 30874616 / -0.1% 39090631 / 39304395 / -0.5% 0.79 / 0.79 / +0.4%
tpcds_q75/duckdb:vortex-file-compressed 37253557 / 37067086 / +0.5% 49826841 / 48402666 / +2.9% 0.75 / 0.77 / -2.4%
tpcds_q76/duckdb:vortex-file-compressed 12787198 / 12879005 / -0.7% 22648399 / 22058251 / +2.7% 0.56 / 0.58 / -3.3%
tpcds_q77/duckdb:vortex-file-compressed 20599684 / 20386666 / +1.0% 31815957 / 31298903 / +1.7% 0.65 / 0.65 / -0.6%
tpcds_q78/duckdb:vortex-file-compressed 43333946 / 42921238 / +1.0% 54382203 / 52920959 / +2.8% 0.80 / 0.81 / -1.8%
tpcds_q79/duckdb:vortex-file-compressed 17038519 / 17204298 / -1.0% 27909756 / 26915068 / +3.7% 0.61 / 0.64 / -4.5%
tpcds_q80/duckdb:vortex-file-compressed 30100375 / 29835128 / +0.9% 44200477 / 43751968 / +1.0% 0.68 / 0.68 / -0.1%
tpcds_q81/duckdb:vortex-file-compressed 21329750 / 21403570 / -0.3% 30373239 / 30302750 / +0.2% 0.70 / 0.71 / -0.6%
tpcds_q82/duckdb:vortex-file-compressed 9455392 / 9601288 / -1.5% 24209902 / 23700733 / +2.1% 0.39 / 0.41 / -3.6%
tpcds_q83/duckdb:vortex-file-compressed 17543896 / 17487681 / +0.3% 25014397 / 24391032 / +2.6% 0.70 / 0.72 / -2.2%
tpcds_q84/duckdb:vortex-file-compressed 15395354 / 15474432 / -0.5% 22976494 / 23926919 / -4.0% 0.67 / 0.65 / +3.6%
tpcds_q85/duckdb:vortex-file-compressed 25167390 / 25015558 / +0.6% 37570221 / 36358715 / +3.3% 0.67 / 0.69 / -2.6%
tpcds_q86/duckdb:vortex-file-compressed 9926962 / 9625184 / +3.1% 16010448 / 16115124 / -0.6% 0.62 / 0.60 / +3.8%
tpcds_q87/duckdb:vortex-file-compressed 26002446 / 26050646 / -0.2% 33992156 / 33749194 / +0.7% 0.76 / 0.77 / -0.9%
tpcds_q88/duckdb:vortex-file-compressed 30420356 / 30341066 / +0.3% 40295810 / 40666123 / -0.9% 0.75 / 0.75 / +1.2%
tpcds_q89/duckdb:vortex-file-compressed 12090208 / 11880278 / +1.8% 21317631 / 21020275 / +1.4% 0.57 / 0.57 / +0.3%
tpcds_q90/duckdb:vortex-file-compressed 7929489 / 7873380 / +0.7% 14553559 / 15793821 / -7.9% 0.54 / 0.50 / +9.3%
tpcds_q91/duckdb:vortex-file-compressed 14749790 / 14680431 / +0.5% 23471733 / 23432754 / +0.2% 0.63 / 0.63 / +0.3%
tpcds_q92/duckdb:vortex-file-compressed 10509772 / 10362186 / +1.4% 17668508 / 17798675 / -0.7% 0.59 / 0.58 / +2.2%
tpcds_q93/duckdb:vortex-file-compressed 10342126 / 10321070 / +0.2% 22975803 / 22416155 / +2.5% 0.45 / 0.46 / -2.2%
tpcds_q94/duckdb:vortex-file-compressed 22372288 / 22085020 / +1.3% 31444611 / 31715817 / -0.9% 0.71 / 0.70 / +2.2%
tpcds_q95/duckdb:vortex-file-compressed 60683490 / 60520896 / +0.3% 69609538 / 67458992 / +3.2% 0.87 / 0.90 / -2.8%
tpcds_q96/duckdb:vortex-file-compressed 6568925 / 6497133 / +1.1% 15917899 / 15310655 / +4.0% 0.41 / 0.42 / -2.8%
tpcds_q97/duckdb:vortex-file-compressed 23359172 / 22917520 / +1.9% 32583686 / 31822045 / +2.4% 0.72 / 0.72 / -0.5%
tpcds_q98/duckdb:vortex-file-compressed 11054449 / 10919490 / +1.2% 19969751 / 19425955 / +2.8% 0.55 / 0.56 / -1.5%
tpcds_q99/duckdb:vortex-file-compressed 14465898 / 14421880 / +0.3% 22935145 / 22012689 / +4.2% 0.63 / 0.66 / -3.7%
duckdb / parquet / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24233712 / 24093628 / +0.6% 31413385 / 30609636 / +2.6% 0.77 / 0.79 / -2.0%
tpcds_q02/duckdb:parquet 17979856 / 17984803 / -0.0% 24204476 / 24025915 / +0.7% 0.74 / 0.75 / -0.8%
tpcds_q03/duckdb:parquet 9861072 / 9812261 / +0.5% 15825639 / 15610845 / +1.4% 0.62 / 0.63 / -0.9%
tpcds_q04/duckdb:parquet 118328724 / 118053322 / +0.2% 126905879 / 125451786 / +1.2% 0.93 / 0.94 / -0.9%
tpcds_q05/duckdb:parquet 28661111 / 28431532 / +0.8% 32828412 / 33184023 / -1.1% 0.87 / 0.86 / +1.9%
tpcds_q06/duckdb:parquet 26621335 / 26561266 / +0.2% 36112673 / 34919227 / +3.4% 0.74 / 0.76 / -3.1%
tpcds_q07/duckdb:parquet 32083054 / 31458600 / +2.0% 38624030 / 38910397 / -0.7% 0.83 / 0.81 / +2.7%
tpcds_q08/duckdb:parquet 19953206 / 19835614 / +0.6% 26016794 / 26315778 / -1.1% 0.77 / 0.75 / +1.7%
tpcds_q09/duckdb:parquet 27418368 / 27590826 / -0.6% 30656547 / 29561025 / +3.7% 0.89 / 0.93 / -4.2%
tpcds_q10/duckdb:parquet 33012262 / 32550451 / +1.4% 40650502 / 40051128 / +1.5% 0.81 / 0.81 / -0.1%
tpcds_q11/duckdb:parquet 68965920 / 68928280 / +0.1% 77016557 / 76188001 / +1.1% 0.90 / 0.90 / -1.0%
tpcds_q12/duckdb:parquet 14081430 / 13995176 / +0.6% 19348441 / 19053083 / +1.6% 0.73 / 0.73 / -0.9%
tpcds_q13/duckdb:parquet 32794000 / 33308439 / -1.5% 39910815 / 39541391 / +0.9% 0.82 / 0.84 / -2.5%
tpcds_q14/duckdb:parquet 64799162 / 64769091 / +0.0% 68826881 / 68114003 / +1.0% 0.94 / 0.95 / -1.0%
tpcds_q15/duckdb:parquet 16727448 / 16637540 / +0.5% 23234129 / 22243900 / +4.5% 0.72 / 0.75 / -3.7%
tpcds_q16/duckdb:parquet 30316252 / 30104670 / +0.7% 37334659 / 37135181 / +0.5% 0.81 / 0.81 / +0.2%
tpcds_q17/duckdb:parquet 34438512 / 34477460 / -0.1% 40255990 / 40356696 / -0.2% 0.86 / 0.85 / +0.1%
tpcds_q18/duckdb:parquet 47493626 / 47148372 / +0.7% 55070713 / 54249081 / +1.5% 0.86 / 0.87 / -0.8%
tpcds_q19/duckdb:parquet 18898203 / 19018304 / -0.6% 25942908 / 25382414 / +2.2% 0.73 / 0.75 / -2.8%
tpcds_q20/duckdb:parquet 15018738 / 14902117 / +0.8% 20158741 / 19412123 / +3.8% 0.75 / 0.77 / -3.0%
tpcds_q21/duckdb:parquet 10680435 / 10731116 / -0.5% 17011566 / 17030686 / -0.1% 0.63 / 0.63 / -0.4%
tpcds_q22/duckdb:parquet 20943730 / 20507718 / +2.1% 26927959 / 26762155 / +0.6% 0.78 / 0.77 / +1.5%
tpcds_q23/duckdb:parquet 43786055 / 42833082 / +2.2% 47726416 / 49424056 / -3.4% 0.92 / 0.87 / +5.9%
tpcds_q24/duckdb:parquet 31702622 / 29943294 / +5.9% 37860042 / 36464447 / +3.8% 0.84 / 0.82 / +2.0%
tpcds_q25/duckdb:parquet 30654546 / 30514354 / +0.5% 37695233 / 37025273 / +1.8% 0.81 / 0.82 / -1.3%
tpcds_q26/duckdb:parquet 29099258 / 29252328 / -0.5% 35634728 / 35038512 / +1.7% 0.82 / 0.83 / -2.2%
tpcds_q27/duckdb:parquet 36162236 / 34872377 / +3.7% 41803919 / 41229992 / +1.4% 0.87 / 0.85 / +2.3%
tpcds_q28/duckdb:parquet 26606165 / 25185258 / +5.6% 32900263 / 31104212 / +5.8% 0.81 / 0.81 / -0.1%
tpcds_q29/duckdb:parquet 32289724 / 32150195 / +0.4% 39832906 / 38969206 / +2.2% 0.81 / 0.83 / -1.7%
tpcds_q30/duckdb:parquet 35753642 / 35528874 / +0.6% 44847535 / 44172843 / +1.5% 0.80 / 0.80 / -0.9%
tpcds_q31/duckdb:parquet 35649401 / 35529000 / +0.3% 43404863 / 42639874 / +1.8% 0.82 / 0.83 / -1.4%
tpcds_q32/duckdb:parquet 14341038 / 14179243 / +1.1% 21326967 / 21025962 / +1.4% 0.67 / 0.67 / -0.3%
tpcds_q33/duckdb:parquet 24146960 / 23095442 / +4.6% 29375364 / 28549004 / +2.9% 0.82 / 0.81 / +1.6%
tpcds_q34/duckdb:parquet 20235510 / 16952271 / +19.4% 🔴 24246507 / 24176719 / +0.3% 0.83 / 0.70 / +19.0%
tpcds_q35/duckdb:parquet 35720408 / 34975734 / +2.1% 44762270 / 43207543 / +3.6% 0.80 / 0.81 / -1.4%
tpcds_q36/duckdb:parquet 41857164 / 39485050 / +6.0% 47934692 / 47479406 / +1.0% 0.87 / 0.83 / +5.0%
tpcds_q37/duckdb:parquet 12680884 / 12797622 / -0.9% 19570529 / 19277008 / +1.5% 0.65 / 0.66 / -2.4%
tpcds_q38/duckdb:parquet 29831854 / 29621006 / +0.7% 34659335 / 33433489 / +3.7% 0.86 / 0.89 / -2.9%
tpcds_q39/duckdb:parquet 23655227 / 23128167 / +2.3% 30216032 / 29595365 / +2.1% 0.78 / 0.78 / +0.2%
tpcds_q40/duckdb:parquet 16193321 / 16054940 / +0.9% 21622553 / 21235777 / +1.8% 0.75 / 0.76 / -0.9%
tpcds_q41/duckdb:parquet 11964116 / 11966633 / -0.0% 18068890 / 18065700 / +0.0% 0.66 / 0.66 / -0.0%
tpcds_q42/duckdb:parquet 9569226 / 9626178 / -0.6% 15760866 / 15525610 / +1.5% 0.61 / 0.62 / -2.1%
tpcds_q43/duckdb:parquet 12128422 / 12048868 / +0.7% 18235837 / 18128038 / +0.6% 0.67 / 0.66 / +0.1%
tpcds_q44/duckdb:parquet 22483246 / 21607511 / +4.1% 29925601 / 26196804 / +14.2% 🔴 0.75 / 0.82 / -8.9%
tpcds_q45/duckdb:parquet 20954004 / 20908743 / +0.2% 28439437 / 27486675 / +3.5% 0.74 / 0.76 / -3.1%
tpcds_q46/duckdb:parquet 36976010 / 35288508 / +4.8% 43777301 / 43320711 / +1.1% 0.84 / 0.81 / +3.7%
tpcds_q47/duckdb:parquet 34474228 / 34531498 / -0.2% 41871425 / 41336316 / +1.3% 0.82 / 0.84 / -1.4%
tpcds_q48/duckdb:parquet 29769968 / 29103170 / +2.3% 37272187 / 36426435 / +2.3% 0.80 / 0.80 / -0.0%
tpcds_q49/duckdb:parquet 29118556 / 30233053 / -3.7% 36260861 / 36303817 / -0.1% 0.80 / 0.83 / -3.6%
tpcds_q50/duckdb:parquet 19502933 / 20388898 / -4.3% 25808520 / 25331399 / +1.9% 0.76 / 0.80 / -6.1%
tpcds_q51/duckdb:parquet 52475527 / 52104356 / +0.7% 77618795 / 61245199 / +26.7% 🔴 0.68 / 0.85 / -20.5%
tpcds_q52/duckdb:parquet 9709662 / 9659180 / +0.5% 15588651 / 15499988 / +0.6% 0.62 / 0.62 / -0.0%
tpcds_q53/duckdb:parquet 13830924 / 14537118 / -4.9% 21306574 / 20752143 / +2.7% 0.65 / 0.70 / -7.3%
tpcds_q54/duckdb:parquet 24918748 / 24733616 / +0.7% 32101678 / 31908376 / +0.6% 0.78 / 0.78 / +0.1%
tpcds_q55/duckdb:parquet 9551458 / 9489484 / +0.7% 15550109 / 15341981 / +1.4% 0.61 / 0.62 / -0.7%
tpcds_q56/duckdb:parquet 27240269 / 27141406 / +0.4% 30821417 / 30419221 / +1.3% 0.88 / 0.89 / -0.9%
tpcds_q57/duckdb:parquet 30446224 / 30693180 / -0.8% 36105054 / 36167354 / -0.2% 0.84 / 0.85 / -0.6%
tpcds_q58/duckdb:parquet 24912240 / 23919381 / +4.2% 30073958 / 29814453 / +0.9% 0.83 / 0.80 / +3.3%
tpcds_q59/duckdb:parquet 23085580 / 22867650 / +1.0% 28533278 / 28707391 / -0.6% 0.81 / 0.80 / +1.6%
tpcds_q60/duckdb:parquet 27579755 / 26316208 / +4.8% 32604175 / 31957179 / +2.0% 0.85 / 0.82 / +2.7%
tpcds_q61/duckdb:parquet 24762970 / 24749493 / +0.1% 29544903 / 29026258 / +1.8% 0.84 / 0.85 / -1.7%
tpcds_q62/duckdb:parquet 12855524 / 12721642 / +1.1% 18057973 / 17771445 / +1.6% 0.71 / 0.72 / -0.6%
tpcds_q63/duckdb:parquet 13443400 / 14341675 / -6.3% 20699807 / 20011856 / +3.4% 0.65 / 0.72 / -9.4%
tpcds_q64/duckdb:parquet 70677876 / 70307914 / +0.5% 81443698 / 79575965 / +2.3% 0.87 / 0.88 / -1.8%
tpcds_q65/duckdb:parquet 21692674 / 20569484 / +5.5% 25630159 / 25477560 / +0.6% 0.85 / 0.81 / +4.8%
tpcds_q66/duckdb:parquet 33401810 / 33045765 / +1.1% 38067470 / 38019443 / +0.1% 0.88 / 0.87 / +0.9%
tpcds_q67/duckdb:parquet 60725374 / 61027914 / -0.5% 68052825 / 66818321 / +1.8% 0.89 / 0.91 / -2.3%
tpcds_q68/duckdb:parquet 28520254 / 30834914 / -7.5% 37113412 / 35993030 / +3.1% 0.77 / 0.86 / -10.3%
tpcds_q69/duckdb:parquet 26317485 / 25794512 / +2.0% 34458980 / 33964184 / +1.5% 0.76 / 0.76 / +0.6%
tpcds_q70/duckdb:parquet 19316767 / 19255869 / +0.3% 27471232 / 26582665 / +3.3% 0.70 / 0.72 / -2.9%
tpcds_q71/duckdb:parquet 18324183 / 16803522 / +9.0% 24767444 / 23382022 / +5.9% 0.74 / 0.72 / +2.9%
tpcds_q72/duckdb:parquet 53151418 / 53014220 / +0.3% 59294985 / 59449489 / -0.3% 0.90 / 0.89 / +0.5%
tpcds_q73/duckdb:parquet 16159188 / 15895421 / +1.7% 21702083 / 21585777 / +0.5% 0.74 / 0.74 / +1.1%
tpcds_q74/duckdb:parquet 84945850 / 85004257 / -0.1% 91675100 / 89575448 / +2.3% 0.93 / 0.95 / -2.4%
tpcds_q75/duckdb:parquet 45527332 / 44183878 / +3.0% 50774250 / 49282250 / +3.0% 0.90 / 0.90 / +0.0%
tpcds_q76/duckdb:parquet 18441316 / 18510097 / -0.4% 24022878 / 22802776 / +5.4% 0.77 / 0.81 / -5.4%
tpcds_q77/duckdb:parquet 25854962 / 25530442 / +1.3% 31757926 / 31441226 / +1.0% 0.81 / 0.81 / +0.3%
tpcds_q78/duckdb:parquet 78251460 / 78229121 / +0.0% 86430248 / 85641462 / +0.9% 0.91 / 0.91 / -0.9%
tpcds_q79/duckdb:parquet 22948162 / 24067906 / -4.7% 29513124 / 28358044 / +4.1% 0.78 / 0.85 / -8.4%
tpcds_q80/duckdb:parquet 35840080 / 38479893 / -6.9% 43620381 / 43843592 / -0.5% 0.82 / 0.88 / -6.4%
tpcds_q81/duckdb:parquet 36714566 / 36125748 / +1.6% 45033270 / 44907713 / +0.3% 0.82 / 0.80 / +1.3%
tpcds_q82/duckdb:parquet 13513254 / 13496682 / +0.1% 20771017 / 20103202 / +3.3% 0.65 / 0.67 / -3.1%
tpcds_q83/duckdb:parquet 20214234 / 19941274 / +1.4% 25513927 / 24813592 / +2.8% 0.79 / 0.80 / -1.4%
tpcds_q84/duckdb:parquet 22989911 / 23090262 / -0.4% 29165714 / 28462809 / +2.5% 0.79 / 0.81 / -2.8%
tpcds_q85/duckdb:parquet 32447927 / 32217004 / +0.7% 39411339 / 38985194 / +1.1% 0.82 / 0.83 / -0.4%
tpcds_q86/duckdb:parquet 11834661 / 11811458 / +0.2% 17236900 / 16496302 / +4.5% 0.69 / 0.72 / -4.1%
tpcds_q87/duckdb:parquet 31714598 / 31436775 / +0.9% 35435105 / 35185024 / +0.7% 0.90 / 0.89 / +0.2%
tpcds_q88/duckdb:parquet 38325654 / 38059442 / +0.7% 43744695 / 41928306 / +4.3% 0.88 / 0.91 / -3.5%
tpcds_q89/duckdb:parquet 14188986 / 14206404 / -0.1% 21784181 / 21172421 / +2.9% 0.65 / 0.67 / -2.9%
tpcds_q90/duckdb:parquet 10201692 / 10080660 / +1.2% 15151503 / 15448563 / -1.9% 0.67 / 0.65 / +3.2%
tpcds_q91/duckdb:parquet 21199059 / 21048574 / +0.7% 28640597 / 28220317 / +1.5% 0.74 / 0.75 / -0.8%
tpcds_q92/duckdb:parquet 15580068 / 15572126 / +0.1% 22167430 / 22096515 / +0.3% 0.70 / 0.70 / -0.3%
tpcds_q93/duckdb:parquet 14186528 / 14091483 / +0.7% 20280128 / 20175447 / +0.5% 0.70 / 0.70 / +0.2%
tpcds_q94/duckdb:parquet 25396218 / 25392360 / +0.0% 32867019 / 32388339 / +1.5% 0.77 / 0.78 / -1.4%
tpcds_q95/duckdb:parquet 43999728 / 43748374 / +0.6% 49714841 / 49895274 / -0.4% 0.89 / 0.88 / +0.9%
tpcds_q96/duckdb:parquet 8287300 / 8272491 / +0.2% 13826463 / 13988491 / -1.2% 0.60 / 0.59 / +1.4%
tpcds_q97/duckdb:parquet 27337672 / 27667050 / -1.2% 34324546 / 32852985 / +4.5% 0.80 / 0.84 / -5.4%
tpcds_q98/duckdb:parquet 16394715 / 16378365 / +0.1% 23025936 / 22777602 / +1.1% 0.71 / 0.72 / -1.0%
tpcds_q99/duckdb:parquet 18687696 / 18807829 / -0.6% 24762652 / 24915617 / -0.6% 0.75 / 0.75 / -0.0%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 6e7759e9 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.988x ➖
Parquet (geomean): hot 0.993x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1260456 / 1277762 / -1.4% 23883901 / 22701905 / +5.2% 0.05 / 0.06 / -6.2%
clickbench_q01/datafusion:vortex-file-compressed 5968047 / 5701054 / +4.7% 30015995 / 34133473 / -12.1% 🟢 0.20 / 0.17 / +19.0%
clickbench_q02/datafusion:vortex-file-compressed 11730587 / 11059978 / +6.1% 48131316 / 45727346 / +5.3% 0.24 / 0.24 / +0.8%
clickbench_q03/datafusion:vortex-file-compressed 13205082 / 12962152 / +1.9% 54766263 / 59966511 / -8.7% 0.24 / 0.22 / +11.5%
clickbench_q04/datafusion:vortex-file-compressed 57616196 / 58491492 / -1.5% 102396219 / 107265399 / -4.5% 0.56 / 0.55 / +3.2%
clickbench_q05/datafusion:vortex-file-compressed 74663172 / 75324188 / -0.9% 125865887 / 127176489 / -1.0% 0.59 / 0.59 / +0.2%
clickbench_q06/datafusion:vortex-file-compressed 1242908 / 1281209 / -3.0% 21952945 / 22762946 / -3.6% 0.06 / 0.06 / +0.6%
clickbench_q07/datafusion:vortex-file-compressed 9108258 / 9121962 / -0.2% 33902252 / 36679638 / -7.6% 0.27 / 0.25 / +8.0%
clickbench_q08/datafusion:vortex-file-compressed 78220858 / 79202689 / -1.2% 123080272 / 130034036 / -5.3% 0.64 / 0.61 / +4.3%
clickbench_q09/datafusion:vortex-file-compressed 171856884 / 169891930 / +1.2% 220384736 / 215849640 / +2.1% 0.78 / 0.79 / -0.9%
clickbench_q10/datafusion:vortex-file-compressed 22201207 / 23576041 / -5.8% 70587981 / 71620517 / -1.4% 0.31 / 0.33 / -4.5%
clickbench_q11/datafusion:vortex-file-compressed 24910704 / 25595211 / -2.7% 70274597 / 73456297 / -4.3% 0.35 / 0.35 / +1.7%
clickbench_q12/datafusion:vortex-file-compressed 71212444 / 72340317 / -1.6% 124645452 / 126525748 / -1.5% 0.57 / 0.57 / -0.1%
clickbench_q13/datafusion:vortex-file-compressed 116211752 / 114454353 / +1.5% 182301526 / 187159194 / -2.6% 0.64 / 0.61 / +4.2%
clickbench_q14/datafusion:vortex-file-compressed 74175903 / 75015054 / -1.1% 127913215 / 128127094 / -0.2% 0.58 / 0.59 / -1.0%
clickbench_q15/datafusion:vortex-file-compressed 61982095 / 63035252 / -1.7% 98536478 / 102527113 / -3.9% 0.63 / 0.61 / +2.3%
clickbench_q16/datafusion:vortex-file-compressed 151922810 / 154339830 / -1.6% 214431713 / 220216995 / -2.6% 0.71 / 0.70 / +1.1%
clickbench_q17/datafusion:vortex-file-compressed 150943507 / 153975190 / -2.0% 220689534 / 221571282 / -0.4% 0.68 / 0.69 / -1.6%
clickbench_q18/datafusion:vortex-file-compressed 289178860 / 297646745 / -2.8% 393089151 / 388335753 / +1.2% 0.74 / 0.77 / -4.0%
clickbench_q19/datafusion:vortex-file-compressed 7619607 / 7750414 / -1.7% 48870672 / 48721099 / +0.3% 0.16 / 0.16 / -2.0%
clickbench_q20/datafusion:vortex-file-compressed 71321772 / 68136855 / +4.7% 246598172 / 256425057 / -3.8% 0.29 / 0.27 / +8.8%
clickbench_q21/datafusion:vortex-file-compressed 77409628 / 80037805 / -3.3% 289135925 / 300737630 / -3.9% 0.27 / 0.27 / +0.6%
clickbench_q22/datafusion:vortex-file-compressed 91152519 / 95054287 / -4.1% 397239362 / 395336147 / +0.5% 0.23 / 0.24 / -4.6%
clickbench_q23/datafusion:vortex-file-compressed 85167608 / 80171206 / +6.2% 406046971 / 416246090 / -2.5% 0.21 / 0.19 / +8.9%
clickbench_q24/datafusion:vortex-file-compressed 8826452 / 8409700 / +5.0% 55853977 / 57093319 / -2.2% 0.16 / 0.15 / +7.3%
clickbench_q25/datafusion:vortex-file-compressed 18511018 / 18152158 / +2.0% 64472783 / 63410099 / +1.7% 0.29 / 0.29 / +0.3%
clickbench_q26/datafusion:vortex-file-compressed 15113112 / 15624998 / -3.3% 69430789 / 69615012 / -0.3% 0.22 / 0.22 / -3.0%
clickbench_q27/datafusion:vortex-file-compressed 98794573 / 100553100 / -1.7% 257159005 / 266070098 / -3.3% 0.38 / 0.38 / +1.7%
clickbench_q28/datafusion:vortex-file-compressed 551177918 / 561882003 / -1.9% 645035874 / 634483917 / +1.7% 0.85 / 0.89 / -3.5%
clickbench_q29/datafusion:vortex-file-compressed 24523026 / 24813306 / -1.2% 61179500 / 53938850 / +13.4% 🔴 0.40 / 0.46 / -12.9%
clickbench_q30/datafusion:vortex-file-compressed 54770123 / 54469824 / +0.6% 111906963 / 110322321 / +1.4% 0.49 / 0.49 / -0.9%
clickbench_q31/datafusion:vortex-file-compressed 64107634 / 63713036 / +0.6% 155258141 / 165094546 / -6.0% 0.41 / 0.39 / +7.0%
clickbench_q32/datafusion:vortex-file-compressed 289892735 / 287471359 / +0.8% 384157189 / 395194655 / -2.8% 0.75 / 0.73 / +3.7%
clickbench_q33/datafusion:vortex-file-compressed 319610800 / 318812426 / +0.3% 436222643 / 434359824 / +0.4% 0.73 / 0.73 / -0.2%
clickbench_q34/datafusion:vortex-file-compressed 320760817 / 319825400 / +0.3% 431909320 / 438643717 / -1.5% 0.74 / 0.73 / +1.9%
clickbench_q35/datafusion:vortex-file-compressed 56781109 / 56594294 / +0.3% 93208624 / 89838837 / +3.8% 0.61 / 0.63 / -3.3%
clickbench_q36/datafusion:vortex-file-compressed 37615362 / 37371240 / +0.7% 68645365 / 69504069 / -1.2% 0.55 / 0.54 / +1.9%
clickbench_q37/datafusion:vortex-file-compressed 20695718 / 20731798 / -0.2% 48856992 / 48713358 / +0.3% 0.42 / 0.43 / -0.5%
clickbench_q38/datafusion:vortex-file-compressed 12660989 / 12866674 / -1.6% 42254338 / 41261053 / +2.4% 0.30 / 0.31 / -3.9%
clickbench_q39/datafusion:vortex-file-compressed 78295754 / 78717482 / -0.5% 113320325 / 110822448 / +2.3% 0.69 / 0.71 / -2.7%
clickbench_q40/datafusion:vortex-file-compressed 10400304 / 10368860 / +0.3% 36848019 / 36576948 / +0.7% 0.28 / 0.28 / -0.4%
clickbench_q41/datafusion:vortex-file-compressed 9681257 / 9655634 / +0.3% 36122668 / 35212183 / +2.6% 0.27 / 0.27 / -2.3%
clickbench_q42/datafusion:vortex-file-compressed 9712092 / 9562990 / +1.6% 36200133 / 37134881 / -2.5% 0.27 / 0.26 / +4.2%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1240468 / 1245508 / -0.4% 51198132 / 49111389 / +4.2% 0.02 / 0.03 / -4.5%
clickbench_q01/datafusion:parquet 15753357 / 16128558 / -2.3% 67443665 / 65974016 / +2.2% 0.23 / 0.24 / -4.5%
clickbench_q02/datafusion:parquet 18897518 / 18679866 / +1.2% 82326234 / 81045048 / +1.6% 0.23 / 0.23 / -0.4%
clickbench_q03/datafusion:parquet 17260179 / 17636144 / -2.1% 82371327 / 78906984 / +4.4% 0.21 / 0.22 / -6.2%
clickbench_q04/datafusion:parquet 64231925 / 63147200 / +1.7% 123775805 / 123651426 / +0.1% 0.52 / 0.51 / +1.6%
clickbench_q05/datafusion:parquet 87645582 / 89173734 / -1.7% 156696399 / 155684349 / +0.7% 0.56 / 0.57 / -2.3%
clickbench_q06/datafusion:parquet 1252152 / 1267736 / -1.2% 49889214 / 49808656 / +0.2% 0.03 / 0.03 / -1.4%
clickbench_q07/datafusion:parquet 16758466 / 16815682 / -0.3% 70760768 / 68530680 / +3.3% 0.24 / 0.25 / -3.5%
clickbench_q08/datafusion:parquet 84520543 / 84420552 / +0.1% 163920250 / 159615748 / +2.7% 0.52 / 0.53 / -2.5%
clickbench_q09/datafusion:parquet 188158998 / 189340200 / -0.6% 278931799 / 270568486 / +3.1% 0.67 / 0.70 / -3.6%
clickbench_q10/datafusion:parquet 35844516 / 35838825 / +0.0% 102548886 / 101351871 / +1.2% 0.35 / 0.35 / -1.2%
clickbench_q11/datafusion:parquet 42194310 / 43388606 / -2.8% 110284462 / 110234963 / +0.0% 0.38 / 0.39 / -2.8%
clickbench_q12/datafusion:parquet 95404510 / 96400254 / -1.0% 165987308 / 164380304 / +1.0% 0.57 / 0.59 / -2.0%
clickbench_q13/datafusion:parquet 149828416 / 149050407 / +0.5% 227140756 / 229020286 / -0.8% 0.66 / 0.65 / +1.4%
clickbench_q14/datafusion:parquet 101831486 / 101751008 / +0.1% 176027037 / 173752765 / +1.3% 0.58 / 0.59 / -1.2%
clickbench_q15/datafusion:parquet 69705937 / 74751018 / -6.7% 131305295 / 132562825 / -0.9% 0.53 / 0.56 / -5.9%
clickbench_q16/datafusion:parquet 155303059 / 157130106 / -1.2% 237483349 / 235404102 / +0.9% 0.65 / 0.67 / -2.0%
clickbench_q17/datafusion:parquet 155620582 / 158408130 / -1.8% 237581135 / 232535206 / +2.2% 0.66 / 0.68 / -3.8%
clickbench_q18/datafusion:parquet 312208706 / 311659828 / +0.2% 420142424 / 428769037 / -2.0% 0.74 / 0.73 / +2.2%
clickbench_q19/datafusion:parquet 18782978 / 18808941 / -0.1% 78923029 / 76943382 / +2.6% 0.24 / 0.24 / -2.6%
clickbench_q20/datafusion:parquet 178156369 / 178190524 / -0.0% 295947864 / 283067790 / +4.6% 0.60 / 0.63 / -4.4%
clickbench_q21/datafusion:parquet 175388644 / 174542982 / +0.5% 313393184 / 303338278 / +3.3% 0.56 / 0.58 / -2.7%
clickbench_q22/datafusion:parquet 260723095 / 260781561 / -0.0% 457406682 / 433914101 / +5.4% 0.57 / 0.60 / -5.2%
clickbench_q23/datafusion:parquet 1003812350 / 1007396844 / -0.4% 1191214879 / 1196675958 / -0.5% 0.84 / 0.84 / +0.1%
clickbench_q24/datafusion:parquet 29897416 / 30726530 / -2.7% 90547825 / 88445505 / +2.4% 0.33 / 0.35 / -5.0%
clickbench_q25/datafusion:parquet 37045298 / 37097776 / -0.1% 105333585 / 103458997 / +1.8% 0.35 / 0.36 / -1.9%
clickbench_q26/datafusion:parquet 30561101 / 30667637 / -0.3% 91365516 / 89958756 / +1.6% 0.33 / 0.34 / -1.9%
clickbench_q27/datafusion:parquet 193037498 / 193541858 / -0.3% 303984719 / 294014301 / +3.4% 0.64 / 0.66 / -3.5%
clickbench_q28/datafusion:parquet 619038524 / 622381386 / -0.5% 705438874 / 709605194 / -0.6% 0.88 / 0.88 / +0.1%
clickbench_q29/datafusion:parquet 29181270 / 28382270 / +2.8% 91327515 / 89726118 / +1.8% 0.32 / 0.32 / +1.0%
clickbench_q30/datafusion:parquet 89698894 / 90292652 / -0.7% 177267088 / 173921114 / +1.9% 0.51 / 0.52 / -2.5%
clickbench_q31/datafusion:parquet 105001858 / 103509501 / +1.4% 198919393 / 200971596 / -1.0% 0.53 / 0.52 / +2.5%
clickbench_q32/datafusion:parquet 306055644 / 311115870 / -1.6% 423325167 / 428727602 / -1.3% 0.72 / 0.73 / -0.4%
clickbench_q33/datafusion:parquet 376086460 / 380048496 / -1.0% 475434741 / 479600127 / -0.9% 0.79 / 0.79 / -0.2%
clickbench_q34/datafusion:parquet 376704052 / 378557524 / -0.5% 476882944 / 477936899 / -0.2% 0.79 / 0.79 / -0.3%
clickbench_q35/datafusion:parquet 63721614 / 64249088 / -0.8% 125836149 / 123443405 / +1.9% 0.51 / 0.52 / -2.7%
clickbench_q36/datafusion:parquet 73524954 / 73977852 / -0.6% 136364920 / 136178878 / +0.1% 0.54 / 0.54 / -0.7%
clickbench_q37/datafusion:parquet 35603314 / 35633496 / -0.1% 90546262 / 91419997 / -1.0% 0.39 / 0.39 / +0.9%
clickbench_q38/datafusion:parquet 47826686 / 47903072 / -0.2% 107961443 / 108411604 / -0.4% 0.44 / 0.44 / +0.3%
clickbench_q39/datafusion:parquet 143971689 / 144526362 / -0.4% 212583553 / 212015185 / +0.3% 0.68 / 0.68 / -0.7%
clickbench_q40/datafusion:parquet 19743350 / 20349552 / -3.0% 76798572 / 77770096 / -1.2% 0.26 / 0.26 / -1.8%
clickbench_q41/datafusion:parquet 18582296 / 18824178 / -1.3% 75249679 / 74972994 / +0.4% 0.25 / 0.25 / -1.6%
clickbench_q42/datafusion:parquet 19021486 / 19068224 / -0.2% 75875919 / 75207188 / +0.9% 0.25 / 0.25 / -1.1%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2207718 / 2239520 / -1.4% 24517688 / 25410828 / -3.5% 0.09 / 0.09 / +2.2%
clickbench_q01/duckdb:vortex-file-compressed 7373288 / 7612362 / -3.1% 26860191 / 27570446 / -2.6% 0.27 / 0.28 / -0.6%
clickbench_q02/duckdb:vortex-file-compressed 9264055 / 8955066 / +3.5% 36070125 / 35286118 / +2.2% 0.26 / 0.25 / +1.2%
clickbench_q03/duckdb:vortex-file-compressed 14294100 / 14248936 / +0.3% 50936699 / 52216942 / -2.5% 0.28 / 0.27 / +2.8%
clickbench_q04/duckdb:vortex-file-compressed 55968376 / 58104275 / -3.7% 91503362 / 92470080 / -1.0% 0.61 / 0.63 / -2.7%
clickbench_q05/duckdb:vortex-file-compressed 64379240 / 64657906 / -0.4% 94873814 / 95177701 / -0.3% 0.68 / 0.68 / -0.1%
clickbench_q06/duckdb:vortex-file-compressed 2625646 / 2703474 / -2.9% 30124197 / 31007170 / -2.8% 0.09 / 0.09 / -0.0%
clickbench_q07/duckdb:vortex-file-compressed 9166896 / 9579114 / -4.3% 27676134 / 31815161 / -13.0% 🟢 0.33 / 0.30 / +10.0%
clickbench_q08/duckdb:vortex-file-compressed 70705376 / 69709164 / +1.4% 106389743 / 106513332 / -0.1% 0.66 / 0.65 / +1.5%
clickbench_q09/duckdb:vortex-file-compressed 92578026 / 91790526 / +0.9% 131754168 / 128038059 / +2.9% 0.70 / 0.72 / -2.0%
clickbench_q10/duckdb:vortex-file-compressed 27112776 / 27449552 / -1.2% 68836812 / 70633742 / -2.5% 0.39 / 0.39 / +1.4%
clickbench_q11/duckdb:vortex-file-compressed 29799950 / 29742802 / +0.2% 72883585 / 74580099 / -2.3% 0.41 / 0.40 / +2.5%
clickbench_q12/duckdb:vortex-file-compressed 67995205 / 68314645 / -0.5% 94432364 / 101588585 / -7.0% 0.72 / 0.67 / +7.1%
clickbench_q13/duckdb:vortex-file-compressed 118729790 / 117681350 / +0.9% 165299817 / 167304335 / -1.2% 0.72 / 0.70 / +2.1%
clickbench_q14/duckdb:vortex-file-compressed 72006870 / 71707574 / +0.4% 100964626 / 104097981 / -3.0% 0.71 / 0.69 / +3.5%
clickbench_q15/duckdb:vortex-file-compressed 76677606 / 76256368 / +0.6% 109995475 / 109430960 / +0.5% 0.70 / 0.70 / +0.0%
clickbench_q16/duckdb:vortex-file-compressed 137208832 / 136865666 / +0.3% 172624141 / 173157180 / -0.3% 0.79 / 0.79 / +0.6%
clickbench_q17/duckdb:vortex-file-compressed 139682514 / 136309250 / +2.5% 170266231 / 167679771 / +1.5% 0.82 / 0.81 / +0.9%
clickbench_q18/duckdb:vortex-file-compressed 261151074 / 253680418 / +2.9% 294207344 / 304490936 / -3.4% 0.89 / 0.83 / +6.5%
clickbench_q19/duckdb:vortex-file-compressed 9130176 / 9195282 / -0.7% 37102959 / 41073291 / -9.7% 0.25 / 0.22 / +9.9%
clickbench_q20/duckdb:vortex-file-compressed 67051683 / 68396690 / -2.0% 173927290 / 175446093 / -0.9% 0.39 / 0.39 / -1.1%
clickbench_q21/duckdb:vortex-file-compressed 77805446 / 78139710 / -0.4% 192038943 / 193510866 / -0.8% 0.41 / 0.40 / +0.3%
clickbench_q22/duckdb:vortex-file-compressed 131448382 / 130674448 / +0.6% 322991236 / 331574805 / -2.6% 0.41 / 0.39 / +3.3%
clickbench_q23/duckdb:vortex-file-compressed 64815321 / 59653655 / +8.7% 183185586 / 184899542 / -0.9% 0.35 / 0.32 / +9.7%
clickbench_q24/duckdb:vortex-file-compressed 16420184 / 17394194 / -5.6% 49169908 / 48703041 / +1.0% 0.33 / 0.36 / -6.5%
clickbench_q25/duckdb:vortex-file-compressed 17874064 / 18446944 / -3.1% 51735467 / 54178597 / -4.5% 0.35 / 0.34 / +1.5%
clickbench_q26/duckdb:vortex-file-compressed 13673022 / 14287748 / -4.3% 43867753 / 49047912 / -10.6% 🟢 0.31 / 0.29 / +7.0%
clickbench_q27/duckdb:vortex-file-compressed 52648254 / 53905176 / -2.3% 176122548 / 177354906 / -0.7% 0.30 / 0.30 / -1.6%
clickbench_q28/duckdb:vortex-file-compressed 506995005 / 514093187 / -1.4% 564112514 / 559504615 / +0.8% 0.90 / 0.92 / -2.2%
clickbench_q29/duckdb:vortex-file-compressed 17157446 / 17208508 / -0.3% 46891836 / 42958313 / +9.2% 0.37 / 0.40 / -8.7%
clickbench_q30/duckdb:vortex-file-compressed 59285323 / 59435691 / -0.3% 110036294 / 108956696 / +1.0% 0.54 / 0.55 / -1.2%
clickbench_q31/duckdb:vortex-file-compressed 108482750 / 109401092 / -0.8% 202135598 / 174239306 / +16.0% 🔴 0.54 / 0.63 / -14.5%
clickbench_q32/duckdb:vortex-file-compressed 361561224 / 385910546 / -6.3% 397765580 / 410231765 / -3.0% 0.91 / 0.94 / -3.4%
clickbench_q33/duckdb:vortex-file-compressed 335840094 / 342599656 / -2.0% 396231051 / 396100171 / +0.0% 0.85 / 0.86 / -2.0%
clickbench_q34/duckdb:vortex-file-compressed 356966458 / 353396204 / +1.0% 404781788 / 412222797 / -1.8% 0.88 / 0.86 / +2.9%
clickbench_q35/duckdb:vortex-file-compressed 57880343 / 57161666 / +1.3% 88704164 / 88929172 / -0.3% 0.65 / 0.64 / +1.5%
clickbench_q36/duckdb:vortex-file-compressed 10967949 / 11640787 / -5.8% 32900847 / 33117280 / -0.7% 0.33 / 0.35 / -5.2%
clickbench_q37/duckdb:vortex-file-compressed 7475249 / 7579217 / -1.4% 27629938 / 29023829 / -4.8% 0.27 / 0.26 / +3.6%
clickbench_q38/duckdb:vortex-file-compressed 8268402 / 8249762 / +0.2% 29509276 / 27872473 / +5.9% 0.28 / 0.30 / -5.3%
clickbench_q39/duckdb:vortex-file-compressed 18408534 / 18512246 / -0.6% 39427783 / 39648155 / -0.6% 0.47 / 0.47 / -0.0%
clickbench_q40/duckdb:vortex-file-compressed 6722053 / 6788686 / -1.0% 28208492 / 29122522 / -3.1% 0.24 / 0.23 / +2.2%
clickbench_q41/duckdb:vortex-file-compressed 7714804 / 7935220 / -2.8% 29204899 / 31671742 / -7.8% 0.26 / 0.25 / +5.4%
clickbench_q42/duckdb:vortex-file-compressed 7004488 / 7022668 / -0.3% 28535615 / 27458837 / +3.9% 0.25 / 0.26 / -4.0%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9529374 / 9394832 / +1.4% 14464144 / 14721122 / -1.7% 0.66 / 0.64 / +3.2%
clickbench_q01/duckdb:parquet 14964378 / 15255306 / -1.9% 19648944 / 20612271 / -4.7% 0.76 / 0.74 / +2.9%
clickbench_q02/duckdb:parquet 22149865 / 23202924 / -4.5% 30964388 / 34409503 / -10.0% 🟢 0.72 / 0.67 / +6.1%
clickbench_q03/duckdb:parquet 23095319 / 22805660 / +1.3% 33452902 / 37416814 / -10.6% 🟢 0.69 / 0.61 / +13.3%
clickbench_q04/duckdb:parquet 61044120 / 62729622 / -2.7% 71569530 / 74237821 / -3.6% 0.85 / 0.84 / +0.9%
clickbench_q05/duckdb:parquet 81338259 / 82553121 / -1.5% 99100060 / 95555827 / +3.7% 0.82 / 0.86 / -5.0%
clickbench_q06/duckdb:parquet 20271212 / 20223452 / +0.2% 28949274 / 27478087 / +5.4% 0.70 / 0.74 / -4.9%
clickbench_q07/duckdb:parquet 17462108 / 17993160 / -3.0% 26241366 / 22337709 / +17.5% 🔴 0.67 / 0.81 / -17.4%
clickbench_q08/duckdb:parquet 74508218 / 75074766 / -0.8% 88623976 / 93024452 / -4.7% 0.84 / 0.81 / +4.2%
clickbench_q09/duckdb:parquet 103463722 / 103794619 / -0.3% 120667100 / 121917219 / -1.0% 0.86 / 0.85 / +0.7%
clickbench_q10/duckdb:parquet 41724070 / 41383818 / +0.8% 54122938 / 53619651 / +0.9% 0.77 / 0.77 / -0.1%
clickbench_q11/duckdb:parquet 46253086 / 46643339 / -0.8% 61858875 / 61615297 / +0.4% 0.75 / 0.76 / -1.2%
clickbench_q12/duckdb:parquet 92105772 / 93595602 / -1.6% 109366392 / 108115697 / +1.2% 0.84 / 0.87 / -2.7%
clickbench_q13/duckdb:parquet 149423374 / 148244281 / +0.8% 167808842 / 168231324 / -0.3% 0.89 / 0.88 / +1.0%
clickbench_q14/duckdb:parquet 99744307 / 101682435 / -1.9% 116841281 / 114164311 / +2.3% 0.85 / 0.89 / -4.2%
clickbench_q15/duckdb:parquet 85119646 / 85946628 / -1.0% 99577996 / 100644448 / -1.1% 0.85 / 0.85 / +0.1%
clickbench_q16/duckdb:parquet 160284759 / 165498386 / -3.2% 199856778 / 179975882 / +11.0% 🔴 0.80 / 0.92 / -12.8%
clickbench_q17/duckdb:parquet 160820211 / 171531960 / -6.2% 177537606 / 178665714 / -0.6% 0.91 / 0.96 / -5.6%
clickbench_q18/duckdb:parquet 290006938 / 291016272 / -0.3% 317216301 / 315607081 / +0.5% 0.91 / 0.92 / -0.9%
clickbench_q19/duckdb:parquet 19411899 / 19859715 / -2.3% 27456334 / 25786255 / +6.5% 0.71 / 0.77 / -8.2%
clickbench_q20/duckdb:parquet 185565806 / 180420120 / +2.9% 228060487 / 232480084 / -1.9% 0.81 / 0.78 / +4.8%
clickbench_q21/duckdb:parquet 216583358 / 218477350 / -0.9% 264790459 / 262983512 / +0.7% 0.82 / 0.83 / -1.5%
clickbench_q22/duckdb:parquet 306886110 / 304926990 / +0.6% 369649177 / 357379579 / +3.4% 0.83 / 0.85 / -2.7%
clickbench_q23/duckdb:parquet 172057680 / 171775762 / +0.2% 246822136 / 253121056 / -2.5% 0.70 / 0.68 / +2.7%
clickbench_q24/duckdb:parquet 31112312 / 29958716 / +3.9% 43735767 / 42482462 / +3.0% 0.71 / 0.71 / +0.9%
clickbench_q25/duckdb:parquet 41585116 / 42463750 / -2.1% 58560800 / 60982131 / -4.0% 0.71 / 0.70 / +2.0%
clickbench_q26/duckdb:parquet 29921296 / 32739711 / -8.6% 49811538 / 47017556 / +5.9% 0.60 / 0.70 / -13.7%
clickbench_q27/duckdb:parquet 188547212 / 191541398 / -1.6% 223474088 / 230295986 / -3.0% 0.84 / 0.83 / +1.4%
clickbench_q28/duckdb:parquet 954847145 / 950006560 / +0.5% 939190689 / 983079731 / -4.5% 1.02 / 0.97 / +5.2%
clickbench_q29/duckdb:parquet 23569744 / 24317362 / -3.1% 30155503 / 30925214 / -2.5% 0.78 / 0.79 / -0.6%
clickbench_q30/duckdb:parquet 104483756 / 104622488 / -0.1% 125810065 / 129419189 / -2.8% 0.83 / 0.81 / +2.7%
clickbench_q31/duckdb:parquet 156781068 / 160480217 / -2.3% 174467277 / 174417616 / +0.0% 0.90 / 0.92 / -2.3%
clickbench_q32/duckdb:parquet 385569454 / 385925739 / -0.1% 408427202 / 407659843 / +0.2% 0.94 / 0.95 / -0.3%
clickbench_q33/duckdb:parquet 465557236 / 468922366 / -0.7% 445456636 / 442695781 / +0.6% 1.05 / 1.06 / -1.3%
clickbench_q34/duckdb:parquet 483440724 / 462238432 / +4.6% 476356052 / 447629696 / +6.4% 1.01 / 1.03 / -1.7%
clickbench_q35/duckdb:parquet 60776458 / 61543474 / -1.2% 75184393 / 77479685 / -3.0% 0.81 / 0.79 / +1.8%
clickbench_q36/duckdb:parquet 29952536 / 30172014 / -0.7% 36221628 / 36925558 / -1.9% 0.83 / 0.82 / +1.2%
clickbench_q37/duckdb:parquet 23318312 / 23204022 / +0.5% 29173364 / 30425350 / -4.1% 0.80 / 0.76 / +4.8%
clickbench_q38/duckdb:parquet 23682320 / 23431136 / +1.1% 30100328 / 30912378 / -2.6% 0.79 / 0.76 / +3.8%
clickbench_q39/duckdb:parquet 52846988 / 52956229 / -0.2% 60475225 / 60047399 / +0.7% 0.87 / 0.88 / -0.9%
clickbench_q40/duckdb:parquet 14465508 / 14924840 / -3.1% 19727108 / 20066747 / -1.7% 0.73 / 0.74 / -1.4%
clickbench_q41/duckdb:parquet 15711642 / 15331596 / +2.5% 20337343 / 23069987 / -11.8% 🟢 0.77 / 0.66 / +16.2%
clickbench_q42/duckdb:parquet 14608691 / 14130908 / +3.4% 20885824 / 20120985 / +3.8% 0.70 / 0.70 / -0.4%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 6e7759e9 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.026x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6127784 / 6250168 / -2.0% 20855756 / 19751173 / +5.6% 0.29 / 0.32 / -7.2%
fineweb_q01/datafusion:vortex-file-compressed 8810774 / 9285400 / -5.1% 40742303 / 35575139 / +14.5% 🔴 0.22 / 0.26 / -17.1%
fineweb_q02/datafusion:vortex-file-compressed 11415443 / 10567512 / +8.0% 40979008 / 40643432 / +0.8% 0.28 / 0.26 / +7.1%
fineweb_q03/datafusion:vortex-file-compressed 17578606 / 17539240 / +0.2% 107888899 / 102692107 / +5.1% 0.16 / 0.17 / -4.6%
fineweb_q04/datafusion:vortex-file-compressed 66454766 / 64090120 / +3.7% 145143200 / 144508483 / +0.4% 0.46 / 0.44 / +3.2%
fineweb_q05/datafusion:vortex-file-compressed 61642536 / 63203121 / -2.5% 152990781 / 139485427 / +9.7% 0.40 / 0.45 / -11.1%
fineweb_q06/datafusion:vortex-file-compressed 16734365 / 17269226 / -3.1% 107315255 / 106346388 / +0.9% 0.16 / 0.16 / -4.0%
fineweb_q07/datafusion:vortex-file-compressed 17345342 / 16748794 / +3.6% 104186490 / 103498538 / +0.7% 0.17 / 0.16 / +2.9%
fineweb_q08/datafusion:vortex-file-compressed 8350462 / 8455804 / -1.2% 27287293 / 26524896 / +2.9% 0.31 / 0.32 / -4.0%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9406033 / 9321344 / +0.9% 33939577 / 32543553 / +4.3% 0.28 / 0.29 / -3.2%
fineweb_q01/datafusion:parquet 73917770 / 75943192 / -2.7% 156954844 / 168115168 / -6.6% 0.47 / 0.45 / +4.3%
fineweb_q02/datafusion:parquet 74439378 / 75797688 / -1.8% 155986297 / 156430678 / -0.3% 0.48 / 0.48 / -1.5%
fineweb_q03/datafusion:parquet 74565718 / 73828035 / +1.0% 155797305 / 151042261 / +3.1% 0.48 / 0.49 / -2.1%
fineweb_q04/datafusion:parquet 82630187 / 82454360 / +0.2% 154773751 / 161665686 / -4.3% 0.53 / 0.51 / +4.7%
fineweb_q05/datafusion:parquet 81537402 / 81339953 / +0.2% 154928112 / 155427779 / -0.3% 0.53 / 0.52 / +0.6%
fineweb_q06/datafusion:parquet 75378638 / 76823475 / -1.9% 154043808 / 164720545 / -6.5% 0.49 / 0.47 / +4.9%
fineweb_q07/datafusion:parquet 74732756 / 73784924 / +1.3% 154397456 / 154776922 / -0.2% 0.48 / 0.48 / +1.5%
fineweb_q08/datafusion:parquet 73241438 / 73667172 / -0.6% 155157619 / 153339658 / +1.2% 0.47 / 0.48 / -1.7%
duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2006460 / 2129396 / -5.8% 7344114 / 8430467 / -12.9% 🟢 0.27 / 0.25 / +8.2%
fineweb_q01/duckdb:vortex-file-compressed 7243760 / 7609840 / -4.8% 27461402 / 27699884 / -0.9% 0.26 / 0.27 / -4.0%
fineweb_q02/duckdb:vortex-file-compressed 9309012 / 8999654 / +3.4% 28178996 / 32238453 / -12.6% 🟢 0.33 / 0.28 / +18.3%
fineweb_q03/duckdb:vortex-file-compressed 18681726 / 17999961 / +3.8% 97728947 / 89729159 / +8.9% 0.19 / 0.20 / -4.7%
fineweb_q04/duckdb:vortex-file-compressed 65197314 / 64895256 / +0.5% 109324523 / 105319449 / +3.8% 0.60 / 0.62 / -3.2%
fineweb_q05/duckdb:vortex-file-compressed 64762960 / 64576607 / +0.3% 106583537 / 100642505 / +5.9% 0.61 / 0.64 / -5.3%
fineweb_q06/duckdb:vortex-file-compressed 17475182 / 17451004 / +0.1% 97536702 / 90997772 / +7.2% 0.18 / 0.19 / -6.6%
fineweb_q07/duckdb:vortex-file-compressed 16706528 / 17567882 / -4.9% 97343167 / 90262327 / +7.8% 0.17 / 0.19 / -11.8%
fineweb_q08/duckdb:vortex-file-compressed 5272928 / 4479276 / +17.7% 🔴 13030689 / 12680631 / +2.8% 0.40 / 0.35 / +14.6%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23505355 / 23575786 / -0.3% 28005635 / 27901054 / +0.4% 0.84 / 0.84 / -0.7%
fineweb_q01/duckdb:parquet 53762972 / 53435612 / +0.6% 73363627 / 71035947 / +3.3% 0.73 / 0.75 / -2.6%
fineweb_q02/duckdb:parquet 57685720 / 58133262 / -0.8% 77533742 / 71614459 / +8.3% 0.74 / 0.81 / -8.3%
fineweb_q03/duckdb:parquet 119011556 / 119431288 / -0.4% 176063035 / 174813976 / +0.7% 0.68 / 0.68 / -1.1%
fineweb_q04/duckdb:parquet 162681925 / 160054805 / +1.6% 204891238 / 201506963 / +1.7% 0.79 / 0.79 / -0.0%
fineweb_q05/duckdb:parquet 157942630 / 159362006 / -0.9% 205832058 / 199292933 / +3.3% 0.77 / 0.80 / -4.0%
fineweb_q06/duckdb:parquet 90599016 / 88786282 / +2.0% 149002872 / 152544283 / -2.3% 0.61 / 0.58 / +4.5%
fineweb_q07/duckdb:parquet 89799454 / 90890989 / -1.2% 146818493 / 143350764 / +2.4% 0.61 / 0.63 / -3.5%
fineweb_q08/duckdb:parquet 28713440 / 28981936 / -0.9% 30149256 / 30002232 / +0.5% 0.95 / 0.97 / -1.4%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 6e7759e9 vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.986x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15569809 / 15688950 / -0.8% 46856536 / 42044683 / +11.4% 🔴 0.33 / 0.37 / -11.0%
tpch_q02/datafusion:vortex-file-compressed 17350907 / 17642963 / -1.7% 39462332 / 38300817 / +3.0% 0.44 / 0.46 / -4.5%
tpch_q03/datafusion:vortex-file-compressed 19274839 / 19065844 / +1.1% 47074210 / 48397388 / -2.7% 0.41 / 0.39 / +3.9%
tpch_q04/datafusion:vortex-file-compressed 10145255 / 11164861 / -9.1% 36782711 / 35072742 / +4.9% 0.28 / 0.32 / -13.4%
tpch_q05/datafusion:vortex-file-compressed 37824308 / 37464731 / +1.0% 68823894 / 67783021 / +1.5% 0.55 / 0.55 / -0.6%
tpch_q06/datafusion:vortex-file-compressed 4382054 / 4339682 / +1.0% 26077274 / 24863986 / +4.9% 0.17 / 0.17 / -3.7%
tpch_q07/datafusion:vortex-file-compressed 52179901 / 52692511 / -1.0% 82573364 / 85054942 / -2.9% 0.63 / 0.62 / +2.0%
tpch_q08/datafusion:vortex-file-compressed 52386646 / 52605829 / -0.4% 83076298 / 84709539 / -1.9% 0.63 / 0.62 / +1.5%
tpch_q09/datafusion:vortex-file-compressed 47747344 / 48498381 / -1.5% 81067706 / 84507228 / -4.1% 0.59 / 0.57 / +2.6%
tpch_q10/datafusion:vortex-file-compressed 17632830 / 17830636 / -1.1% 52986091 / 50418361 / +5.1% 0.33 / 0.35 / -5.9%
tpch_q11/datafusion:vortex-file-compressed 14602194 / 14797088 / -1.3% 34592379 / 34636066 / -0.1% 0.42 / 0.43 / -1.2%
tpch_q12/datafusion:vortex-file-compressed 18518196 / 18367682 / +0.8% 47227769 / 44324157 / +6.6% 0.39 / 0.41 / -5.4%
tpch_q13/datafusion:vortex-file-compressed 19158096 / 19445378 / -1.5% 40802839 / 43547559 / -6.3% 0.47 / 0.45 / +5.2%
tpch_q14/datafusion:vortex-file-compressed 14183325 / 14501344 / -2.2% 38409355 / 38502171 / -0.2% 0.37 / 0.38 / -2.0%
tpch_q15/datafusion:vortex-file-compressed 18871760 / 18611040 / +1.4% 44807845 / 47147954 / -5.0% 0.42 / 0.39 / +6.7%
tpch_q16/datafusion:vortex-file-compressed 18330128 / 18720655 / -2.1% 39962746 / 39847079 / +0.3% 0.46 / 0.47 / -2.4%
tpch_q17/datafusion:vortex-file-compressed 28852104 / 28917794 / -0.2% 59846172 / 58954760 / +1.5% 0.48 / 0.49 / -1.7%
tpch_q18/datafusion:vortex-file-compressed 36362513 / 36473671 / -0.3% 57861607 / 59803246 / -3.2% 0.63 / 0.61 / +3.0%
tpch_q19/datafusion:vortex-file-compressed 9752332 / 9988295 / -2.4% 36274031 / 36396214 / -0.3% 0.27 / 0.27 / -2.0%
tpch_q20/datafusion:vortex-file-compressed 20708543 / 21253874 / -2.6% 47447308 / 52124094 / -9.0% 0.44 / 0.41 / +7.0%
tpch_q21/datafusion:vortex-file-compressed 35263236 / 35502918 / -0.7% 66016612 / 66036777 / -0.0% 0.53 / 0.54 / -0.6%
tpch_q22/datafusion:vortex-file-compressed 10895462 / 10854425 / +0.4% 30888290 / 31535557 / -2.1% 0.35 / 0.34 / +2.5%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71035717 / 71385078 / -0.5% 88942932 / 87261585 / +1.9% 0.80 / 0.82 / -2.4%
tpch_q02/datafusion:parquet 76424624 / 76624116 / -0.3% 92139728 / 91913452 / +0.2% 0.83 / 0.83 / -0.5%
tpch_q03/datafusion:parquet 81876442 / 82108255 / -0.3% 102298784 / 104243587 / -1.9% 0.80 / 0.79 / +1.6%
tpch_q04/datafusion:parquet 39072755 / 39117802 / -0.1% 58062375 / 58381793 / -0.5% 0.67 / 0.67 / +0.4%
tpch_q05/datafusion:parquet 110607764 / 110097915 / +0.5% 138276200 / 137152327 / +0.8% 0.80 / 0.80 / -0.4%
tpch_q06/datafusion:parquet 31533008 / 31364851 / +0.5% 48051707 / 46559945 / +3.2% 0.66 / 0.67 / -2.6%
tpch_q07/datafusion:parquet 113260717 / 113603354 / -0.3% 139801232 / 139063930 / +0.5% 0.81 / 0.82 / -0.8%
tpch_q08/datafusion:parquet 117190342 / 118351864 / -1.0% 142885120 / 143663582 / -0.5% 0.82 / 0.82 / -0.4%
tpch_q09/datafusion:parquet 136935463 / 137262432 / -0.2% 166219208 / 166772416 / -0.3% 0.82 / 0.82 / +0.1%
tpch_q10/datafusion:parquet 103315620 / 103456749 / -0.1% 127101657 / 126729504 / +0.3% 0.81 / 0.82 / -0.4%
tpch_q11/datafusion:parquet 62171587 / 62363006 / -0.3% 82213898 / 82069278 / +0.2% 0.76 / 0.76 / -0.5%
tpch_q12/datafusion:parquet 63569530 / 63533745 / +0.1% 85447595 / 85351184 / +0.1% 0.74 / 0.74 / -0.1%
tpch_q13/datafusion:parquet 143520074 / 142477870 / +0.7% 161422527 / 161849930 / -0.3% 0.89 / 0.88 / +1.0%
tpch_q14/datafusion:parquet 47279089 / 47624060 / -0.7% 71870652 / 68804881 / +4.5% 0.66 / 0.69 / -5.0%
tpch_q15/datafusion:parquet 74936454 / 74880432 / +0.1% 96114099 / 92266259 / +4.2% 0.78 / 0.81 / -3.9%
tpch_q16/datafusion:parquet 42825199 / 43181694 / -0.8% 61566387 / 59549382 / +3.4% 0.70 / 0.73 / -4.1%
tpch_q17/datafusion:parquet 123898543 / 123682757 / +0.2% 149376624 / 147020505 / +1.6% 0.83 / 0.84 / -1.4%
tpch_q18/datafusion:parquet 120353784 / 121104227 / -0.6% 141459600 / 142447395 / -0.7% 0.85 / 0.85 / +0.1%
tpch_q19/datafusion:parquet 57087603 / 57774413 / -1.2% 82196207 / 82236501 / -0.0% 0.69 / 0.70 / -1.1%
tpch_q20/datafusion:parquet 78606313 / 78510463 / +0.1% 103012925 / 101516128 / +1.5% 0.76 / 0.77 / -1.3%
tpch_q21/datafusion:parquet 113336023 / 113088915 / +0.2% 137779536 / 139363438 / -1.1% 0.82 / 0.81 / +1.4%
tpch_q22/datafusion:parquet 51912666 / 51831048 / +0.2% 68397745 / 67131696 / +1.9% 0.76 / 0.77 / -1.7%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9481271 / 9046497 / +4.8% 18797244 / 20027987 / -6.1% 0.50 / 0.45 / +11.7%
tpch_q02/duckdb:vortex-file-compressed 15154353 / 15124900 / +0.2% 25347719 / 25341316 / +0.0% 0.60 / 0.60 / +0.2%
tpch_q03/duckdb:vortex-file-compressed 18498513 / 18447734 / +0.3% 36301179 / 34750008 / +4.5% 0.51 / 0.53 / -4.0%
tpch_q04/duckdb:vortex-file-compressed 12259521 / 12448707 / -1.5% 25968547 / 26846587 / -3.3% 0.47 / 0.46 / +1.8%
tpch_q05/duckdb:vortex-file-compressed 20218328 / 20254666 / -0.2% 36037029 / 35776065 / +0.7% 0.56 / 0.57 / -0.9%
tpch_q06/duckdb:vortex-file-compressed 4974611 / 4488820 / +10.8% 🔴 14019180 / 15022696 / -6.7% 0.35 / 0.30 / +18.8%
tpch_q07/duckdb:vortex-file-compressed 24390230 / 23909987 / +2.0% 38765213 / 41780280 / -7.2% 0.63 / 0.57 / +9.9%
tpch_q08/duckdb:vortex-file-compressed 20927933 / 20744171 / +0.9% 35603952 / 37318055 / -4.6% 0.59 / 0.56 / +5.7%
tpch_q09/duckdb:vortex-file-compressed 22123757 / 23055861 / -4.0% 37256101 / 38487753 / -3.2% 0.59 / 0.60 / -0.9%
tpch_q10/duckdb:vortex-file-compressed 26631343 / 26815462 / -0.7% 44143197 / 45530635 / -3.0% 0.60 / 0.59 / +2.4%
tpch_q11/duckdb:vortex-file-compressed 7980862 / 7968318 / +0.2% 16934673 / 18104165 / -6.5% 0.47 / 0.44 / +7.1%
tpch_q12/duckdb:vortex-file-compressed 14721463 / 14764927 / -0.3% 27099503 / 27095283 / +0.0% 0.54 / 0.54 / -0.3%
tpch_q13/duckdb:vortex-file-compressed 19386212 / 19378947 / +0.0% 31689723 / 31743144 / -0.2% 0.61 / 0.61 / +0.2%
tpch_q14/duckdb:vortex-file-compressed 11454012 / 11181264 / +2.4% 23119417 / 25354587 / -8.8% 0.50 / 0.44 / +12.3%
tpch_q15/duckdb:vortex-file-compressed 8305969 / 8381204 / -0.9% 19227671 / 20995174 / -8.4% 0.43 / 0.40 / +8.2%
tpch_q16/duckdb:vortex-file-compressed 16425174 / 16413233 / +0.1% 22269435 / 23979720 / -7.1% 0.74 / 0.68 / +7.8%
tpch_q17/duckdb:vortex-file-compressed 12571303 / 12592677 / -0.2% 28430849 / 28445363 / -0.1% 0.44 / 0.44 / -0.1%
tpch_q18/duckdb:vortex-file-compressed 23715254 / 24316808 / -2.5% 34509208 / 34951044 / -1.3% 0.69 / 0.70 / -1.2%
tpch_q19/duckdb:vortex-file-compressed 11568616 / 11426195 / +1.2% 27605830 / 25766839 / +7.1% 0.42 / 0.44 / -5.5%
tpch_q20/duckdb:vortex-file-compressed 14297458 / 14325643 / -0.2% 30385411 / 30552986 / -0.5% 0.47 / 0.47 / +0.4%
tpch_q21/duckdb:vortex-file-compressed 48755747 / 48281048 / +1.0% 65099304 / 66017908 / -1.4% 0.75 / 0.73 / +2.4%
tpch_q22/duckdb:vortex-file-compressed 16446505 / 16702790 / -1.5% 26179523 / 26800262 / -2.3% 0.63 / 0.62 / +0.8%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47484751 / 47547581 / -0.1% 54122265 / 54112740 / +0.0% 0.88 / 0.88 / -0.1%
tpch_q02/duckdb:parquet 48157122 / 48312217 / -0.3% 55135136 / 55151190 / -0.0% 0.87 / 0.88 / -0.3%
tpch_q03/duckdb:parquet 60229644 / 60217500 / +0.0% 68481925 / 69288935 / -1.2% 0.88 / 0.87 / +1.2%
tpch_q04/duckdb:parquet 34674733 / 34656547 / +0.1% 44092295 / 43053263 / +2.4% 0.79 / 0.80 / -2.3%
tpch_q05/duckdb:parquet 66940408 / 67091722 / -0.2% 77532196 / 77316587 / +0.3% 0.86 / 0.87 / -0.5%
tpch_q06/duckdb:parquet 21586837 / 21601570 / -0.1% 27095278 / 27249425 / -0.6% 0.80 / 0.79 / +0.5%
tpch_q07/duckdb:parquet 63650911 / 63799205 / -0.2% 72061074 / 72405251 / -0.5% 0.88 / 0.88 / +0.2%
tpch_q08/duckdb:parquet 75510143 / 75667269 / -0.2% 86644796 / 86769393 / -0.1% 0.87 / 0.87 / -0.1%
tpch_q09/duckdb:parquet 107324498 / 107847179 / -0.5% 118813033 / 118570948 / +0.2% 0.90 / 0.91 / -0.7%
tpch_q10/duckdb:parquet 105613387 / 105720936 / -0.1% 117722804 / 117200993 / +0.4% 0.90 / 0.90 / -0.5%
tpch_q11/duckdb:parquet 29386663 / 29439572 / -0.2% 34997536 / 34922812 / +0.2% 0.84 / 0.84 / -0.4%
tpch_q12/duckdb:parquet 37150922 / 37121505 / +0.1% 44140064 / 43764563 / +0.9% 0.84 / 0.85 / -0.8%
tpch_q13/duckdb:parquet 174618940 / 174812670 / -0.1% 182810540 / 184970583 / -1.2% 0.96 / 0.95 / +1.1%
tpch_q14/duckdb:parquet 42297927 / 42356235 / -0.1% 51061566 / 51063051 / -0.0% 0.83 / 0.83 / -0.1%
tpch_q15/duckdb:parquet 32607137 / 32503990 / +0.3% 41055755 / 41334737 / -0.7% 0.79 / 0.79 / +1.0%
tpch_q16/duckdb:parquet 47106202 / 47147798 / -0.1% 52195790 / 52668299 / -0.9% 0.90 / 0.90 / +0.8%
tpch_q17/duckdb:parquet 47894808 / 47964459 / -0.1% 57882120 / 56795941 / +1.9% 0.83 / 0.84 / -2.0%
tpch_q18/duckdb:parquet 74162599 / 73982405 / +0.2% 79356913 / 80482798 / -1.4% 0.93 / 0.92 / +1.7%
tpch_q19/duckdb:parquet 50292280 / 49071842 / +2.5% 58989196 / 55601512 / +6.1% 0.85 / 0.88 / -3.4%
tpch_q20/duckdb:parquet 63359470 / 63412118 / -0.1% 73678125 / 73364368 / +0.4% 0.86 / 0.86 / -0.5%
tpch_q21/duckdb:parquet 106230890 / 106560704 / -0.3% 115653025 / 116038695 / -0.3% 0.92 / 0.92 / +0.0%
tpch_q22/duckdb:parquet 50401407 / 50470913 / -0.1% 58915309 / 59155611 / -0.4% 0.86 / 0.85 / +0.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 6e7759e9 vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.988x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93377532 / 92177346 / +1.3% 155922103 / 156197099 / -0.2% 0.60 / 0.59 / +1.5%
tpch_q02/datafusion:vortex-file-compressed 66573603 / 64428754 / +3.3% 93223718 / 94872596 / -1.7% 0.71 / 0.68 / +5.2%
tpch_q03/datafusion:vortex-file-compressed 62643447 / 64151894 / -2.4% 118461761 / 126780702 / -6.6% 0.53 / 0.51 / +4.5%
tpch_q04/datafusion:vortex-file-compressed 34076305 / 35028676 / -2.7% 70633456 / 68466710 / +3.2% 0.48 / 0.51 / -5.7%
tpch_q05/datafusion:vortex-file-compressed 119192064 / 118900162 / +0.2% 190869755 / 185439522 / +2.9% 0.62 / 0.64 / -2.6%
tpch_q06/datafusion:vortex-file-compressed 9644970 / 9649196 / -0.0% 56374701 / 57652551 / -2.2% 0.17 / 0.17 / +2.2%
tpch_q07/datafusion:vortex-file-compressed 96488399 / 97449767 / -1.0% 159598740 / 161011516 / -0.9% 0.60 / 0.61 / -0.1%
tpch_q08/datafusion:vortex-file-compressed 143024766 / 142206475 / +0.6% 219374549 / 226695985 / -3.2% 0.65 / 0.63 / +3.9%
tpch_q09/datafusion:vortex-file-compressed 184320401 / 182840408 / +0.8% 271677528 / 275147335 / -1.3% 0.68 / 0.66 / +2.1%
tpch_q10/datafusion:vortex-file-compressed 70178394 / 70621645 / -0.6% 134843576 / 136262721 / -1.0% 0.52 / 0.52 / +0.4%
tpch_q11/datafusion:vortex-file-compressed 45678036 / 45658051 / +0.0% 69417631 / 72364105 / -4.1% 0.66 / 0.63 / +4.3%
tpch_q12/datafusion:vortex-file-compressed 35792650 / 35235879 / +1.6% 80158897 / 79705799 / +0.6% 0.45 / 0.44 / +1.0%
tpch_q13/datafusion:vortex-file-compressed 49583156 / 48598467 / +2.0% 89072835 / 87210304 / +2.1% 0.56 / 0.56 / -0.1%
tpch_q14/datafusion:vortex-file-compressed 20565131 / 20650370 / -0.4% 84789732 / 88048054 / -3.7% 0.24 / 0.23 / +3.4%
tpch_q15/datafusion:vortex-file-compressed 33022974 / 33753614 / -2.2% 91510454 / 90785220 / +0.8% 0.36 / 0.37 / -2.9%
tpch_q16/datafusion:vortex-file-compressed 37030496 / 36919743 / +0.3% 65401593 / 65843812 / -0.7% 0.57 / 0.56 / +1.0%
tpch_q17/datafusion:vortex-file-compressed 174693527 / 176998771 / -1.3% 223784064 / 239755261 / -6.7% 0.78 / 0.74 / +5.7%
tpch_q18/datafusion:vortex-file-compressed 206358853 / 207996354 / -0.8% 267690350 / 275106107 / -2.7% 0.77 / 0.76 / +2.0%
tpch_q19/datafusion:vortex-file-compressed 27947119 / 28526869 / -2.0% 87462556 / 87666580 / -0.2% 0.32 / 0.33 / -1.8%
tpch_q20/datafusion:vortex-file-compressed 61815575 / 61936223 / -0.2% 114447544 / 118852369 / -3.7% 0.54 / 0.52 / +3.6%
tpch_q21/datafusion:vortex-file-compressed 180745432 / 182704046 / -1.1% 239870971 / 234984863 / +2.1% 0.75 / 0.78 / -3.1%
tpch_q22/datafusion:vortex-file-compressed 25727266 / 25513774 / +0.8% 52834413 / 55406439 / -4.6% 0.49 / 0.46 / +5.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86849814 / 87311538 / -0.5% 123206964 / 122516163 / +0.6% 0.70 / 0.71 / -1.1%
tpch_q02/datafusion:parquet 172984597 / 174735537 / -1.0% 194739922 / 198265824 / -1.8% 0.89 / 0.88 / +0.8%
tpch_q03/datafusion:parquet 135013334 / 135233090 / -0.2% 175666796 / 179364012 / -2.1% 0.77 / 0.75 / +1.9%
tpch_q04/datafusion:parquet 57467081 / 56985913 / +0.8% 85378342 / 85885070 / -0.6% 0.67 / 0.66 / +1.4%
tpch_q05/datafusion:parquet 166411556 / 166291221 / +0.1% 220415475 / 214896169 / +2.6% 0.75 / 0.77 / -2.4%
tpch_q06/datafusion:parquet 36322849 / 36510562 / -0.5% 72168480 / 72908306 / -1.0% 0.50 / 0.50 / +0.5%
tpch_q07/datafusion:parquet 215945197 / 215778947 / +0.1% 273431137 / 260314182 / +5.0% 0.79 / 0.83 / -4.7%
tpch_q08/datafusion:parquet 217392288 / 216791369 / +0.3% 281503733 / 278971702 / +0.9% 0.77 / 0.78 / -0.6%
tpch_q09/datafusion:parquet 309689375 / 307685989 / +0.7% 381254806 / 369588127 / +3.2% 0.81 / 0.83 / -2.4%
tpch_q10/datafusion:parquet 312383058 / 311954014 / +0.1% 359585237 / 359417304 / +0.0% 0.87 / 0.87 / +0.1%
tpch_q11/datafusion:parquet 127403385 / 127035714 / +0.3% 146978789 / 149936598 / -2.0% 0.87 / 0.85 / +2.3%
tpch_q12/datafusion:parquet 81705186 / 82433202 / -0.9% 114152167 / 116835758 / -2.3% 0.72 / 0.71 / +1.4%
tpch_q13/datafusion:parquet 210108458 / 210618688 / -0.2% 237788624 / 238788117 / -0.4% 0.88 / 0.88 / +0.2%
tpch_q14/datafusion:parquet 86861270 / 85602024 / +1.5% 191950663 / 186569859 / +2.9% 0.45 / 0.46 / -1.4%
tpch_q15/datafusion:parquet 106390049 / 106606603 / -0.2% 151612608 / 154598932 / -1.9% 0.70 / 0.69 / +1.8%
tpch_q16/datafusion:parquet 94487707 / 94683007 / -0.2% 120298027 / 123221265 / -2.4% 0.79 / 0.77 / +2.2%
tpch_q17/datafusion:parquet 212982632 / 215630850 / -1.2% 262665945 / 257798988 / +1.9% 0.81 / 0.84 / -3.1%
tpch_q18/datafusion:parquet 269505784 / 267541314 / +0.7% 308772391 / 318452912 / -3.0% 0.87 / 0.84 / +3.9%
tpch_q19/datafusion:parquet 107964693 / 108282497 / -0.3% 164999711 / 164045798 / +0.6% 0.65 / 0.66 / -0.9%
tpch_q20/datafusion:parquet 185034702 / 185298197 / -0.1% 236525956 / 237189433 / -0.3% 0.78 / 0.78 / +0.1%
tpch_q21/datafusion:parquet 241629068 / 244268713 / -1.1% 308880122 / 306493573 / +0.8% 0.78 / 0.80 / -1.8%
tpch_q22/datafusion:parquet 149799327 / 149723897 / +0.1% 168499588 / 171986203 / -2.0% 0.89 / 0.87 / +2.1%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32557573 / 33162813 / -1.8% 60594813 / 60965941 / -0.6% 0.54 / 0.54 / -1.2%
tpch_q02/duckdb:vortex-file-compressed 28569320 / 28441284 / +0.5% 41982544 / 42490796 / -1.2% 0.68 / 0.67 / +1.7%
tpch_q03/duckdb:vortex-file-compressed 51651690 / 51806352 / -0.3% 97409133 / 96181102 / +1.3% 0.53 / 0.54 / -1.6%
tpch_q04/duckdb:vortex-file-compressed 51683005 / 51520893 / +0.3% 83864716 / 83080389 / +0.9% 0.62 / 0.62 / -0.6%
tpch_q05/duckdb:vortex-file-compressed 68440259 / 68278233 / +0.2% 105147808 / 110549285 / -4.9% 0.65 / 0.62 / +5.4%
tpch_q06/duckdb:vortex-file-compressed 14945894 / 14995905 / -0.3% 48460148 / 49678736 / -2.5% 0.31 / 0.30 / +2.2%
tpch_q07/duckdb:vortex-file-compressed 55180053 / 55095502 / +0.2% 103018580 / 99927713 / +3.1% 0.54 / 0.55 / -2.9%
tpch_q08/duckdb:vortex-file-compressed 84289381 / 84730600 / -0.5% 125239037 / 128300677 / -2.4% 0.67 / 0.66 / +1.9%
tpch_q09/duckdb:vortex-file-compressed 102682099 / 102680463 / +0.0% 151000094 / 149752209 / +0.8% 0.68 / 0.69 / -0.8%
tpch_q10/duckdb:vortex-file-compressed 95670861 / 95736829 / -0.1% 141127262 / 145772381 / -3.2% 0.68 / 0.66 / +3.2%
tpch_q11/duckdb:vortex-file-compressed 13031781 / 13161487 / -1.0% 29195026 / 28614710 / +2.0% 0.45 / 0.46 / -3.0%
tpch_q12/duckdb:vortex-file-compressed 45764368 / 45171630 / +1.3% 77538122 / 74559415 / +4.0% 0.59 / 0.61 / -2.6%
tpch_q13/duckdb:vortex-file-compressed 72076284 / 71277113 / +1.1% 96608715 / 98751212 / -2.2% 0.75 / 0.72 / +3.4%
tpch_q14/duckdb:vortex-file-compressed 28154835 / 27742167 / +1.5% 66860652 / 68588058 / -2.5% 0.42 / 0.40 / +4.1%
tpch_q15/duckdb:vortex-file-compressed 23782518 / 24169914 / -1.6% 58136773 / 62760479 / -7.4% 0.41 / 0.39 / +6.2%
tpch_q16/duckdb:vortex-file-compressed 49063254 / 49823920 / -1.5% 60122640 / 58191998 / +3.3% 0.82 / 0.86 / -4.7%
tpch_q17/duckdb:vortex-file-compressed 35319119 / 34928738 / +1.1% 65476882 / 64550565 / +1.4% 0.54 / 0.54 / -0.3%
tpch_q18/duckdb:vortex-file-compressed 107318727 / 102866087 / +4.3% 119607656 / 121696816 / -1.7% 0.90 / 0.85 / +6.2%
tpch_q19/duckdb:vortex-file-compressed 27393988 / 27489534 / -0.3% 71827673 / 76106199 / -5.6% 0.38 / 0.36 / +5.6%
tpch_q20/duckdb:vortex-file-compressed 41219498 / 41385355 / -0.4% 85476545 / 88937430 / -3.9% 0.48 / 0.47 / +3.6%
tpch_q21/duckdb:vortex-file-compressed 91932085 / 92643489 / -0.8% 140446280 / 140692444 / -0.2% 0.65 / 0.66 / -0.6%
tpch_q22/duckdb:vortex-file-compressed 33484367 / 33019958 / +1.4% 47949903 / 47168881 / +1.7% 0.70 / 0.70 / -0.2%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67272298 / 68061708 / -1.2% 85827769 / 88188170 / -2.7% 0.78 / 0.77 / +1.6%
tpch_q02/duckdb:parquet 86836835 / 87254980 / -0.5% 94928815 / 98880371 / -4.0% 0.91 / 0.88 / +3.7%
tpch_q03/duckdb:parquet 109966559 / 110221645 / -0.2% 139402963 / 141238280 / -1.3% 0.79 / 0.78 / +1.1%
tpch_q04/duckdb:parquet 76665710 / 76532636 / +0.2% 96849374 / 97762896 / -0.9% 0.79 / 0.78 / +1.1%
tpch_q05/duckdb:parquet 123834379 / 123479542 / +0.3% 156235145 / 155668079 / +0.4% 0.79 / 0.79 / -0.1%
tpch_q06/duckdb:parquet 35156648 / 35931981 / -2.2% 58435147 / 56977323 / +2.6% 0.60 / 0.63 / -4.6%
tpch_q07/duckdb:parquet 116103164 / 119339250 / -2.7% 155621738 / 153627189 / +1.3% 0.75 / 0.78 / -4.0%
tpch_q08/duckdb:parquet 146884142 / 147255450 / -0.3% 189037934 / 190628929 / -0.8% 0.78 / 0.77 / +0.6%
tpch_q09/duckdb:parquet 236226231 / 235578554 / +0.3% 278706835 / 276803702 / +0.7% 0.85 / 0.85 / -0.4%
tpch_q10/duckdb:parquet 313036345 / 313587478 / -0.2% 334985590 / 337403692 / -0.7% 0.93 / 0.93 / +0.5%
tpch_q11/duckdb:parquet 43533894 / 43490479 / +0.1% 50711429 / 50005616 / +1.4% 0.86 / 0.87 / -1.3%
tpch_q12/duckdb:parquet 70137265 / 70505417 / -0.5% 90393521 / 90007679 / +0.4% 0.78 / 0.78 / -0.9%
tpch_q13/duckdb:parquet 292131934 / 293441858 / -0.4% 307641801 / 310736944 / -1.0% 0.95 / 0.94 / +0.6%
tpch_q14/duckdb:parquet 102071298 / 101133653 / +0.9% 135786061 / 136327535 / -0.4% 0.75 / 0.74 / +1.3%
tpch_q15/duckdb:parquet 57313187 / 57306184 / +0.0% 87920224 / 84972419 / +3.5% 0.65 / 0.67 / -3.3%
tpch_q16/duckdb:parquet 101309407 / 100633707 / +0.7% 107280186 / 107203047 / +0.1% 0.94 / 0.94 / +0.6%
tpch_q17/duckdb:parquet 81153476 / 83962666 / -3.3% 110889438 / 110031995 / +0.8% 0.73 / 0.76 / -4.1%
tpch_q18/duckdb:parquet 157818116 / 157083225 / +0.5% 168784655 / 172862922 / -2.4% 0.94 / 0.91 / +2.9%
tpch_q19/duckdb:parquet 98154939 / 98792583 / -0.6% 130835825 / 130377546 / +0.4% 0.75 / 0.76 / -1.0%
tpch_q20/duckdb:parquet 147418112 / 146971997 / +0.3% 183697438 / 181619680 / +1.1% 0.80 / 0.81 / -0.8%
tpch_q21/duckdb:parquet 252901467 / 254756250 / -0.7% 278585685 / 271034790 / +2.8% 0.91 / 0.94 / -3.4%
tpch_q22/duckdb:parquet 168363826 / 168406469 / -0.0% 179452568 / 179252698 / +0.1% 0.94 / 0.94 / -0.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 6e7759e9 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.999x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35403524 / 35836658 / -1.2% 61464600 / 59839649 / +2.7% 0.58 / 0.60 / -3.8%
tpcds_q02/datafusion:vortex-file-compressed 50741930 / 51540980 / -1.6% 74495649 / 75356430 / -1.1% 0.68 / 0.68 / -0.4%
tpcds_q03/datafusion:vortex-file-compressed 21078278 / 20246396 / +4.1% 47348023 / 46166223 / +2.6% 0.45 / 0.44 / +1.5%
tpcds_q04/datafusion:vortex-file-compressed 293992982 / 293432920 / +0.2% 352822204 / 354050198 / -0.3% 0.83 / 0.83 / +0.5%
tpcds_q05/datafusion:vortex-file-compressed 73437529 / 71656747 / +2.5% 99778764 / 107692212 / -7.3% 0.74 / 0.67 / +10.6%
tpcds_q06/datafusion:vortex-file-compressed 42787340 / 42258217 / +1.3% 71203887 / 70535607 / +0.9% 0.60 / 0.60 / +0.3%
tpcds_q07/datafusion:vortex-file-compressed 43322374 / 42156216 / +2.8% 80603967 / 80613054 / -0.0% 0.54 / 0.52 / +2.8%
tpcds_q08/datafusion:vortex-file-compressed 28261485 / 28614063 / -1.2% 58136946 / 57730721 / +0.7% 0.49 / 0.50 / -1.9%
tpcds_q09/datafusion:vortex-file-compressed 43791431 / 44012164 / -0.5% 75889094 / 77101674 / -1.6% 0.58 / 0.57 / +1.1%
tpcds_q10/datafusion:vortex-file-compressed 36370886 / 37189576 / -2.2% 63628338 / 63021635 / +1.0% 0.57 / 0.59 / -3.1%
tpcds_q11/datafusion:vortex-file-compressed 176194702 / 174495550 / +1.0% 220521780 / 221987691 / -0.7% 0.80 / 0.79 / +1.6%
tpcds_q12/datafusion:vortex-file-compressed 17424929 / 17549844 / -0.7% 38081721 / 38571171 / -1.3% 0.46 / 0.45 / +0.6%
tpcds_q13/datafusion:vortex-file-compressed 39137638 / 38899632 / +0.6% 82333334 / 85520203 / -3.7% 0.48 / 0.45 / +4.5%
tpcds_q14/datafusion:vortex-file-compressed 230065077 / 231725092 / -0.7% 270414171 / 271215982 / -0.3% 0.85 / 0.85 / -0.4%
tpcds_q15/datafusion:vortex-file-compressed 40584220 / 40095029 / +1.2% 58845388 / 54164984 / +8.6% 0.69 / 0.74 / -6.8%
tpcds_q16/datafusion:vortex-file-compressed 23175564 / 22869641 / +1.3% 42669821 / 42034772 / +1.5% 0.54 / 0.54 / -0.2%
tpcds_q17/datafusion:vortex-file-compressed 61336416 / 64808376 / -5.4% 99738079 / 89558176 / +11.4% 🔴 0.61 / 0.72 / -15.0%
tpcds_q18/datafusion:vortex-file-compressed 71068306 / 69097730 / +2.9% 99883760 / 94787906 / +5.4% 0.71 / 0.73 / -2.4%
tpcds_q19/datafusion:vortex-file-compressed 22893708 / 22408799 / +2.2% 54465937 / 55496169 / -1.9% 0.42 / 0.40 / +4.1%
tpcds_q20/datafusion:vortex-file-compressed 23869804 / 23702741 / +0.7% 39387495 / 40220803 / -2.1% 0.61 / 0.59 / +2.8%
tpcds_q21/datafusion:vortex-file-compressed 46350475 / 47542674 / -2.5% 72642948 / 64058585 / +13.4% 🔴 0.64 / 0.74 / -14.0%
tpcds_q22/datafusion:vortex-file-compressed 435054040 / 431366016 / +0.9% 456518742 / 465284097 / -1.9% 0.95 / 0.93 / +2.8%
tpcds_q23/datafusion:vortex-file-compressed 302300303 / 299587271 / +0.9% 350069547 / 351318540 / -0.4% 0.86 / 0.85 / +1.3%
tpcds_q24/datafusion:vortex-file-compressed 118115360 / 120023524 / -1.6% 157315469 / 159982078 / -1.7% 0.75 / 0.75 / +0.1%
tpcds_q25/datafusion:vortex-file-compressed 63080446 / 63311010 / -0.4% 100598357 / 102454935 / -1.8% 0.63 / 0.62 / +1.5%
tpcds_q26/datafusion:vortex-file-compressed 37141074 / 37429288 / -0.8% 60256547 / 59331611 / +1.6% 0.62 / 0.63 / -2.3%
tpcds_q27/datafusion:vortex-file-compressed 73396569 / 72377160 / +1.4% 102409901 / 104225546 / -1.7% 0.72 / 0.69 / +3.2%
tpcds_q28/datafusion:vortex-file-compressed 42215108 / 42296916 / -0.2% 94250296 / 82755038 / +13.9% 🔴 0.45 / 0.51 / -12.4%
tpcds_q29/datafusion:vortex-file-compressed 64302674 / 61922299 / +3.8% 105819229 / 97201813 / +8.9% 0.61 / 0.64 / -4.6%
tpcds_q30/datafusion:vortex-file-compressed 51600362 / 51311054 / +0.6% 78318176 / 79114003 / -1.0% 0.66 / 0.65 / +1.6%
tpcds_q31/datafusion:vortex-file-compressed 199237638 / 196557266 / +1.4% 231023950 / 235875877 / -2.1% 0.86 / 0.83 / +3.5%
tpcds_q32/datafusion:vortex-file-compressed 15147914 / 15236954 / -0.6% 31775942 / 31554300 / +0.7% 0.48 / 0.48 / -1.3%
tpcds_q33/datafusion:vortex-file-compressed 33894706 / 33321710 / +1.7% 70830755 / 67027574 / +5.7% 0.48 / 0.50 / -3.7%
tpcds_q34/datafusion:vortex-file-compressed 40502266 / 41148345 / -1.6% 65799518 / 68234625 / -3.6% 0.62 / 0.60 / +2.1%
tpcds_q35/datafusion:vortex-file-compressed 92210882 / 92443260 / -0.3% 122286865 / 120652799 / +1.4% 0.75 / 0.77 / -1.6%
tpcds_q36/datafusion:vortex-file-compressed 65223934 / 65946206 / -1.1% 100609977 / 100250170 / +0.4% 0.65 / 0.66 / -1.4%
tpcds_q37/datafusion:vortex-file-compressed 24863614 / 23553139 / +5.6% 52745482 / 43598667 / +21.0% 🔴 0.47 / 0.54 / -12.7%
tpcds_q38/datafusion:vortex-file-compressed 79606090 / 76507711 / +4.0% 107850420 / 106221269 / +1.5% 0.74 / 0.72 / +2.5%
tpcds_q39/datafusion:vortex-file-compressed 891108488 / 887680404 / +0.4% 908582366 / 906829393 / +0.2% 0.98 / 0.98 / +0.2%
tpcds_q40/datafusion:vortex-file-compressed 28975908 / 28735451 / +0.8% 47734061 / 47789817 / -0.1% 0.61 / 0.60 / +1.0%
tpcds_q41/datafusion:vortex-file-compressed 19528660 / 19056672 / +2.5% 32441515 / 30560191 / +6.2% 0.60 / 0.62 / -3.5%
tpcds_q42/datafusion:vortex-file-compressed 13718758 / 14306364 / -4.1% 41158602 / 39330916 / +4.6% 0.33 / 0.36 / -8.4%
tpcds_q43/datafusion:vortex-file-compressed 16989747 / 17123520 / -0.8% 39888775 / 40887604 / -2.4% 0.43 / 0.42 / +1.7%
tpcds_q44/datafusion:vortex-file-compressed 43305364 / 42841783 / +1.1% 71868155 / 73034215 / -1.6% 0.60 / 0.59 / +2.7%
tpcds_q45/datafusion:vortex-file-compressed 42513706 / 42716522 / -0.5% 66308265 / 64325351 / +3.1% 0.64 / 0.66 / -3.5%
tpcds_q46/datafusion:vortex-file-compressed 72107999 / 70770951 / +1.9% 109618623 / 103002911 / +6.4% 0.66 / 0.69 / -4.3%
tpcds_q47/datafusion:vortex-file-compressed 174853710 / 176930862 / -1.2% 221287666 / 217533458 / +1.7% 0.79 / 0.81 / -2.9%
tpcds_q48/datafusion:vortex-file-compressed 35998346 / 35477019 / +1.5% 71719772 / 70167195 / +2.2% 0.50 / 0.51 / -0.7%
tpcds_q49/datafusion:vortex-file-compressed 76969756 / 79901468 / -3.7% 120381722 / 120233831 / +0.1% 0.64 / 0.66 / -3.8%
tpcds_q50/datafusion:vortex-file-compressed 55479304 / 56310110 / -1.5% 85476230 / 89046429 / -4.0% 0.65 / 0.63 / +2.6%
tpcds_q51/datafusion:vortex-file-compressed 245250852 / 241461239 / +1.6% 281250022 / 280306123 / +0.3% 0.87 / 0.86 / +1.2%
tpcds_q52/datafusion:vortex-file-compressed 14531818 / 14942948 / -2.8% 40255198 / 41146983 / -2.2% 0.36 / 0.36 / -0.6%
tpcds_q53/datafusion:vortex-file-compressed 23274964 / 23025893 / +1.1% 50409614 / 52394142 / -3.8% 0.46 / 0.44 / +5.1%
tpcds_q54/datafusion:vortex-file-compressed 57353136 / 59630808 / -3.8% 90657829 / 92798502 / -2.3% 0.63 / 0.64 / -1.5%
tpcds_q55/datafusion:vortex-file-compressed 14397054 / 15209610 / -5.3% 39715522 / 39200802 / +1.3% 0.36 / 0.39 / -6.6%
tpcds_q56/datafusion:vortex-file-compressed 33631096 / 34211642 / -1.7% 66418544 / 63579406 / +4.5% 0.51 / 0.54 / -5.9%
tpcds_q57/datafusion:vortex-file-compressed 132893044 / 130827096 / +1.6% 161007003 / 162474233 / -0.9% 0.83 / 0.81 / +2.5%
tpcds_q58/datafusion:vortex-file-compressed 48294317 / 49071762 / -1.6% 85933404 / 84738612 / +1.4% 0.56 / 0.58 / -3.0%
tpcds_q59/datafusion:vortex-file-compressed 55326162 / 54936949 / +0.7% 84202562 / 85696270 / -1.7% 0.66 / 0.64 / +2.5%
tpcds_q60/datafusion:vortex-file-compressed 34329952 / 34485962 / -0.5% 66994270 / 66114270 / +1.3% 0.51 / 0.52 / -1.8%
tpcds_q61/datafusion:vortex-file-compressed 45724010 / 45202724 / +1.2% 80214621 / 70916447 / +13.1% 🔴 0.57 / 0.64 / -10.6%
tpcds_q62/datafusion:vortex-file-compressed 18790940 / 19841460 / -5.3% 41998120 / 43084349 / -2.5% 0.45 / 0.46 / -2.8%
tpcds_q63/datafusion:vortex-file-compressed 22553330 / 22619521 / -0.3% 53638038 / 49716174 / +7.9% 0.42 / 0.45 / -7.6%
tpcds_q64/datafusion:vortex-file-compressed 335156440 / 332776120 / +0.7% 397633269 / 399340320 / -0.4% 0.84 / 0.83 / +1.1%
tpcds_q65/datafusion:vortex-file-compressed 74133348 / 73751860 / +0.5% 110984584 / 110569158 / +0.4% 0.67 / 0.67 / +0.1%
tpcds_q66/datafusion:vortex-file-compressed 52927691 / 52486634 / +0.8% 79620431 / 77837826 / +2.3% 0.66 / 0.67 / -1.4%
tpcds_q67/datafusion:vortex-file-compressed 429178718 / 420503111 / +2.1% 497186814 / 528828691 / -6.0% 0.86 / 0.80 / +8.6%
tpcds_q68/datafusion:vortex-file-compressed 66887328 / 66831493 / +0.1% 97999677 / 99391180 / -1.4% 0.68 / 0.67 / +1.5%
tpcds_q69/datafusion:vortex-file-compressed 34921082 / 36278824 / -3.7% 62948436 / 63625322 / -1.1% 0.55 / 0.57 / -2.7%
tpcds_q70/datafusion:vortex-file-compressed 196619157 / 194497137 / +1.1% 226798548 / 232217411 / -2.3% 0.87 / 0.84 / +3.5%
tpcds_q71/datafusion:vortex-file-compressed 25148644 / 25424784 / -1.1% 60351347 / 61267492 / -1.5% 0.42 / 0.41 / +0.4%
tpcds_q72/datafusion:vortex-file-compressed 1616326970 / 1575229677 / +2.6% 1654869589 / 1696144047 / -2.4% 0.98 / 0.93 / +5.2%
tpcds_q73/datafusion:vortex-file-compressed 38808879 / 38589712 / +0.6% 63974932 / 62969996 / +1.6% 0.61 / 0.61 / -1.0%
tpcds_q74/datafusion:vortex-file-compressed 135309938 / 134601274 / +0.5% 170129266 / 173765353 / -2.1% 0.80 / 0.77 / +2.7%
tpcds_q75/datafusion:vortex-file-compressed 152965553 / 155633299 / -1.7% 193123066 / 198511793 / -2.7% 0.79 / 0.78 / +1.0%
tpcds_q76/datafusion:vortex-file-compressed 33603724 / 34722660 / -3.2% 73242111 / 73189101 / +0.1% 0.46 / 0.47 / -3.3%
tpcds_q77/datafusion:vortex-file-compressed 56033673 / 54175824 / +3.4% 89062748 / 87493805 / +1.8% 0.63 / 0.62 / +1.6%
tpcds_q78/datafusion:vortex-file-compressed 141377780 / 140889933 / +0.3% 190276277 / 191779256 / -0.8% 0.74 / 0.73 / +1.1%
tpcds_q79/datafusion:vortex-file-compressed 53930750 / 53408896 / +1.0% 84560901 / 83137730 / +1.7% 0.64 / 0.64 / -0.7%
tpcds_q80/datafusion:vortex-file-compressed 79464818 / 80795658 / -1.6% 128504031 / 127799771 / +0.6% 0.62 / 0.63 / -2.2%
tpcds_q81/datafusion:vortex-file-compressed 55899160 / 55975548 / -0.1% 83269202 / 83846761 / -0.7% 0.67 / 0.67 / +0.6%
tpcds_q82/datafusion:vortex-file-compressed 30675058 / 30549740 / +0.4% 64381042 / 48106493 / +33.8% 🔴 0.48 / 0.64 / -25.0%
tpcds_q83/datafusion:vortex-file-compressed 42904285 / 42358020 / +1.3% 67193222 / 65597866 / +2.4% 0.64 / 0.65 / -1.1%
tpcds_q84/datafusion:vortex-file-compressed 12383741 / 12799204 / -3.2% 31962027 / 30970538 / +3.2% 0.39 / 0.41 / -6.2%
tpcds_q85/datafusion:vortex-file-compressed 59933507 / 60660052 / -1.2% 91202610 / 90654953 / +0.6% 0.66 / 0.67 / -1.8%
tpcds_q86/datafusion:vortex-file-compressed 18362383 / 18272155 / +0.5% 38970241 / 40425570 / -3.6% 0.47 / 0.45 / +4.2%
tpcds_q87/datafusion:vortex-file-compressed 78965373 / 79615489 / -0.8% 110756566 / 107689679 / +2.8% 0.71 / 0.74 / -3.6%
tpcds_q88/datafusion:vortex-file-compressed 53329654 / 56206700 / -5.1% 90457363 / 93094539 / -2.8% 0.59 / 0.60 / -2.4%
tpcds_q89/datafusion:vortex-file-compressed 26592271 / 26931306 / -1.3% 54672455 / 56072635 / -2.5% 0.49 / 0.48 / +1.3%
tpcds_q90/datafusion:vortex-file-compressed 12725639 / 12758200 / -0.3% 31856822 / 34107490 / -6.6% 0.40 / 0.37 / +6.8%
tpcds_q91/datafusion:vortex-file-compressed 20034616 / 19519254 / +2.6% 43019908 / 42141655 / +2.1% 0.47 / 0.46 / +0.5%
tpcds_q92/datafusion:vortex-file-compressed 15089164 / 15245025 / -1.0% 35203728 / 33922326 / +3.8% 0.43 / 0.45 / -4.6%
tpcds_q93/datafusion:vortex-file-compressed 56314294 / 54842766 / +2.7% 90446162 / 88696680 / +2.0% 0.62 / 0.62 / +0.7%
tpcds_q94/datafusion:vortex-file-compressed 21501416 / 21620928 / -0.6% 47167946 / 46231785 / +2.0% 0.46 / 0.47 / -2.5%
tpcds_q95/datafusion:vortex-file-compressed 93035352 / 95000299 / -2.1% 125251795 / 123858370 / +1.1% 0.74 / 0.77 / -3.2%
tpcds_q96/datafusion:vortex-file-compressed 11378970 / 11533278 / -1.3% 31376891 / 31102793 / +0.9% 0.36 / 0.37 / -2.2%
tpcds_q97/datafusion:vortex-file-compressed 39790204 / 39467840 / +0.8% 64826515 / 66425488 / -2.4% 0.61 / 0.59 / +3.3%
tpcds_q98/datafusion:vortex-file-compressed 20730383 / 20665282 / +0.3% 48001168 / 48509099 / -1.0% 0.43 / 0.43 / +1.4%
tpcds_q99/datafusion:vortex-file-compressed 29950093 / 29545800 / +1.4% 48376945 / 48862458 / -1.0% 0.62 / 0.60 / +2.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59081576 / 59408052 / -0.5% 78450508 / 82373568 / -4.8% 0.75 / 0.72 / +4.4%
tpcds_q02/datafusion:parquet 68900639 / 69761366 / -1.2% 90513541 / 90812813 / -0.3% 0.76 / 0.77 / -0.9%
tpcds_q03/datafusion:parquet 28696006 / 28478768 / +0.8% 50358025 / 49334251 / +2.1% 0.57 / 0.58 / -1.3%
tpcds_q04/datafusion:parquet 640933980 / 642610250 / -0.3% 714353595 / 708231753 / +0.9% 0.90 / 0.91 / -1.1%
tpcds_q05/datafusion:parquet 82327548 / 81388832 / +1.2% 115753658 / 113800720 / +1.7% 0.71 / 0.72 / -0.6%
tpcds_q06/datafusion:parquet 91308880 / 90852955 / +0.5% 111696051 / 115952402 / -3.7% 0.82 / 0.78 / +4.3%
tpcds_q07/datafusion:parquet 102201784 / 101418282 / +0.8% 130758180 / 133695330 / -2.2% 0.78 / 0.76 / +3.0%
tpcds_q08/datafusion:parquet 49060176 / 48684130 / +0.8% 75976482 / 74133519 / +2.5% 0.65 / 0.66 / -1.7%
tpcds_q09/datafusion:parquet 75397949 / 75160834 / +0.3% 103993701 / 102849415 / +1.1% 0.73 / 0.73 / -0.8%
tpcds_q10/datafusion:parquet 58351655 / 60416750 / -3.4% 79876104 / 84947233 / -6.0% 0.73 / 0.71 / +2.7%
tpcds_q11/datafusion:parquet 412269628 / 412444870 / -0.0% 452558918 / 461294550 / -1.9% 0.91 / 0.89 / +1.9%
tpcds_q12/datafusion:parquet 40496596 / 39871562 / +1.6% 58538113 / 57128529 / +2.5% 0.69 / 0.70 / -0.9%
tpcds_q13/datafusion:parquet 85324742 / 84637846 / +0.8% 130278514 / 130466094 / -0.1% 0.65 / 0.65 / +1.0%
tpcds_q14/datafusion:parquet 378452225 / 378360104 / +0.0% 412339197 / 433388374 / -4.9% 0.92 / 0.87 / +5.1%
tpcds_q15/datafusion:parquet 51250840 / 51502606 / -0.5% 71106942 / 72303263 / -1.7% 0.72 / 0.71 / +1.2%
tpcds_q16/datafusion:parquet 45505307 / 45710882 / -0.4% 62160286 / 63650471 / -2.3% 0.73 / 0.72 / +1.9%
tpcds_q17/datafusion:parquet 141949466 / 138067928 / +2.8% 166480916 / 172187136 / -3.3% 0.85 / 0.80 / +6.3%
tpcds_q18/datafusion:parquet 108871732 / 110369917 / -1.4% 142657361 / 144952536 / -1.6% 0.76 / 0.76 / +0.2%
tpcds_q19/datafusion:parquet 48264262 / 48384048 / -0.2% 73956160 / 75539146 / -2.1% 0.65 / 0.64 / +1.9%
tpcds_q20/datafusion:parquet 41412696 / 41512735 / -0.2% 54073922 / 55090816 / -1.8% 0.77 / 0.75 / +1.6%
tpcds_q21/datafusion:parquet 61010286 / 61141701 / -0.2% 72952270 / 73095747 / -0.2% 0.84 / 0.84 / -0.0%
tpcds_q22/datafusion:parquet 472346420 / 464195324 / +1.8% 493331451 / 478139930 / +3.2% 0.96 / 0.97 / -1.4%
tpcds_q23/datafusion:parquet 364067832 / 357626356 / +1.8% 424654377 / 417833459 / +1.6% 0.86 / 0.86 / +0.2%
tpcds_q24/datafusion:parquet 244466724 / 241331307 / +1.3% 279380043 / 278266611 / +0.4% 0.88 / 0.87 / +0.9%
tpcds_q25/datafusion:parquet 143205392 / 146902811 / -2.5% 178182902 / 196039200 / -9.1% 0.80 / 0.75 / +7.3%
tpcds_q26/datafusion:parquet 54515768 / 53821080 / +1.3% 78374030 / 80565923 / -2.7% 0.70 / 0.67 / +4.1%
tpcds_q27/datafusion:parquet 212303788 / 210089836 / +1.1% 236153576 / 235911774 / +0.1% 0.90 / 0.89 / +1.0%
tpcds_q28/datafusion:parquet 87695142 / 86784142 / +1.0% 121318323 / 119280232 / +1.7% 0.72 / 0.73 / -0.6%
tpcds_q29/datafusion:parquet 144101419 / 145820741 / -1.2% 177646595 / 175411233 / +1.3% 0.81 / 0.83 / -2.4%
tpcds_q30/datafusion:parquet 98240361 / 99608501 / -1.4% 120757353 / 120071149 / +0.6% 0.81 / 0.83 / -1.9%
tpcds_q31/datafusion:parquet 319912665 / 319058792 / +0.3% 347430906 / 344041143 / +1.0% 0.92 / 0.93 / -0.7%
tpcds_q32/datafusion:parquet 29492101 / 29399552 / +0.3% 42405202 / 43643939 / -2.8% 0.70 / 0.67 / +3.2%
tpcds_q33/datafusion:parquet 54539043 / 51971680 / +4.9% 78550722 / 76538194 / +2.6% 0.69 / 0.68 / +2.3%
tpcds_q34/datafusion:parquet 63568512 / 65511648 / -3.0% 87438444 / 85276600 / +2.5% 0.73 / 0.77 / -5.4%
tpcds_q35/datafusion:parquet 125919619 / 126922984 / -0.8% 152542564 / 150646646 / +1.3% 0.83 / 0.84 / -2.0%
tpcds_q36/datafusion:parquet 99776514 / 97863638 / +2.0% 128840785 / 126419427 / +1.9% 0.77 / 0.77 / +0.0%
tpcds_q37/datafusion:parquet 49980668 / 50046237 / -0.1% 65921784 / 65033749 / +1.4% 0.76 / 0.77 / -1.5%
tpcds_q38/datafusion:parquet 121823892 / 122147195 / -0.3% 145167495 / 145034869 / +0.1% 0.84 / 0.84 / -0.4%
tpcds_q39/datafusion:parquet 851341529 / 846526498 / +0.6% 860320284 / 859437879 / +0.1% 0.99 / 0.98 / +0.5%
tpcds_q40/datafusion:parquet 34754790 / 35936465 / -3.3% 55370043 / 54650564 / +1.3% 0.63 / 0.66 / -4.5%
tpcds_q41/datafusion:parquet 32091976 / 31200319 / +2.9% 43892689 / 42657926 / +2.9% 0.73 / 0.73 / -0.0%
tpcds_q42/datafusion:parquet 26079911 / 25952126 / +0.5% 46136649 / 43716014 / +5.5% 0.57 / 0.59 / -4.8%
tpcds_q43/datafusion:parquet 28051526 / 27372783 / +2.5% 48391278 / 46844617 / +3.3% 0.58 / 0.58 / -0.8%
tpcds_q44/datafusion:parquet 64914884 / 65006033 / -0.1% 85809038 / 87803178 / -2.3% 0.76 / 0.74 / +2.2%
tpcds_q45/datafusion:parquet 65532814 / 66536274 / -1.5% 86284160 / 87212845 / -1.1% 0.76 / 0.76 / -0.4%
tpcds_q46/datafusion:parquet 106840102 / 106805720 / +0.0% 145255622 / 153607976 / -5.4% 0.74 / 0.70 / +5.8%
tpcds_q47/datafusion:parquet 236972244 / 237808994 / -0.4% 277552272 / 273252482 / +1.6% 0.85 / 0.87 / -1.9%
tpcds_q48/datafusion:parquet 78938495 / 76955857 / +2.6% 112664936 / 105870247 / +6.4% 0.70 / 0.73 / -3.6%
tpcds_q49/datafusion:parquet 112485461 / 118898020 / -5.4% 165751611 / 170084458 / -2.5% 0.68 / 0.70 / -2.9%
tpcds_q50/datafusion:parquet 93467346 / 92705258 / +0.8% 122099995 / 120435148 / +1.4% 0.77 / 0.77 / -0.6%
tpcds_q51/datafusion:parquet 254096242 / 254091982 / +0.0% 279414240 / 289211985 / -3.4% 0.91 / 0.88 / +3.5%
tpcds_q52/datafusion:parquet 26652102 / 26889958 / -0.9% 47885577 / 45469536 / +5.3% 0.56 / 0.59 / -5.9%
tpcds_q53/datafusion:parquet 36035987 / 36382336 / -1.0% 60001661 / 57842390 / +3.7% 0.60 / 0.63 / -4.5%
tpcds_q54/datafusion:parquet 86394368 / 85254806 / +1.3% 108299259 / 109551589 / -1.1% 0.80 / 0.78 / +2.5%
tpcds_q55/datafusion:parquet 26514309 / 26510566 / +0.0% 44804834 / 46645823 / -3.9% 0.59 / 0.57 / +4.1%
tpcds_q56/datafusion:parquet 52224526 / 54094848 / -3.5% 76377086 / 77335323 / -1.2% 0.68 / 0.70 / -2.2%
tpcds_q57/datafusion:parquet 170797240 / 171894920 / -0.6% 196390449 / 193978047 / +1.2% 0.87 / 0.89 / -1.9%
tpcds_q58/datafusion:parquet 98130494 / 98465482 / -0.3% 119317657 / 125032548 / -4.6% 0.82 / 0.79 / +4.4%
tpcds_q59/datafusion:parquet 104427620 / 103659830 / +0.7% 135748532 / 130225505 / +4.2% 0.77 / 0.80 / -3.4%
tpcds_q60/datafusion:parquet 56303604 / 55741260 / +1.0% 74757347 / 78220449 / -4.4% 0.75 / 0.71 / +5.7%
tpcds_q61/datafusion:parquet 75669482 / 78001000 / -3.0% 104659522 / 106432779 / -1.7% 0.72 / 0.73 / -1.3%
tpcds_q62/datafusion:parquet 27721227 / 27762318 / -0.1% 45465432 / 44527940 / +2.1% 0.61 / 0.62 / -2.2%
tpcds_q63/datafusion:parquet 36187595 / 36196190 / -0.0% 60212941 / 58834211 / +2.3% 0.60 / 0.62 / -2.3%
tpcds_q64/datafusion:parquet 655624193 / 659557758 / -0.6% 733924507 / 742173662 / -1.1% 0.89 / 0.89 / +0.5%
tpcds_q65/datafusion:parquet 101766508 / 100715906 / +1.0% 133903351 / 133981634 / -0.1% 0.76 / 0.75 / +1.1%
tpcds_q66/datafusion:parquet 76065472 / 76575936 / -0.7% 102314049 / 104374000 / -2.0% 0.74 / 0.73 / +1.3%
tpcds_q67/datafusion:parquet 434057558 / 430912350 / +0.7% 500249011 / 500297658 / -0.0% 0.87 / 0.86 / +0.7%
tpcds_q68/datafusion:parquet 108491766 / 108700552 / -0.2% 157754838 / 156742031 / +0.6% 0.69 / 0.69 / -0.8%
tpcds_q69/datafusion:parquet 60536948 / 61003348 / -0.8% 81050639 / 84325988 / -3.9% 0.75 / 0.72 / +3.2%
tpcds_q70/datafusion:parquet 212300214 / 212975306 / -0.3% 244183060 / 246017700 / -0.7% 0.87 / 0.87 / +0.4%
tpcds_q71/datafusion:parquet 38152351 / 39083124 / -2.4% 64656074 / 64662143 / -0.0% 0.59 / 0.60 / -2.4%
tpcds_q72/datafusion:parquet 1869192638 / 1794732356 / +4.1% 1824035442 / 1806078341 / +1.0% 1.02 / 0.99 / +3.1%
tpcds_q73/datafusion:parquet 62224986 / 62856255 / -1.0% 83703107 / 84855052 / -1.4% 0.74 / 0.74 / +0.4%
tpcds_q74/datafusion:parquet 292555104 / 292768250 / -0.1% 327197895 / 331483495 / -1.3% 0.89 / 0.88 / +1.2%
tpcds_q75/datafusion:parquet 195916172 / 193794623 / +1.1% 240721964 / 239131737 / +0.7% 0.81 / 0.81 / +0.4%
tpcds_q76/datafusion:parquet 50498296 / 49958244 / +1.1% 81773046 / 78897199 / +3.6% 0.62 / 0.63 / -2.5%
tpcds_q77/datafusion:parquet 71803680 / 73280301 / -2.0% 104838029 / 98096657 / +6.9% 0.68 / 0.75 / -8.3%
tpcds_q78/datafusion:parquet 207399408 / 211119866 / -1.8% 271788441 / 273491694 / -0.6% 0.76 / 0.77 / -1.1%
tpcds_q79/datafusion:parquet 78208770 / 77375078 / +1.1% 123298450 / 112413871 / +9.7% 0.63 / 0.69 / -7.8%
tpcds_q80/datafusion:parquet 145318110 / 143104068 / +1.5% 189433832 / 191975662 / -1.3% 0.77 / 0.75 / +2.9%
tpcds_q81/datafusion:parquet 107887154 / 106756472 / +1.1% 129899914 / 129378123 / +0.4% 0.83 / 0.83 / +0.7%
tpcds_q82/datafusion:parquet 54397230 / 53582485 / +1.5% 74548182 / 70410662 / +5.9% 0.73 / 0.76 / -4.1%
tpcds_q83/datafusion:parquet 66989026 / 66630048 / +0.5% 85431134 / 85136032 / +0.3% 0.78 / 0.78 / +0.2%
tpcds_q84/datafusion:parquet 35523026 / 36220898 / -1.9% 49301441 / 49805351 / -1.0% 0.72 / 0.73 / -0.9%
tpcds_q85/datafusion:parquet 106442088 / 103848480 / +2.5% 127156728 / 129149354 / -1.5% 0.84 / 0.80 / +4.1%
tpcds_q86/datafusion:parquet 21603534 / 22112695 / -2.3% 40490101 / 39672664 / +2.1% 0.53 / 0.56 / -4.3%
tpcds_q87/datafusion:parquet 122846362 / 122470358 / +0.3% 146952739 / 148224625 / -0.9% 0.84 / 0.83 / +1.2%
tpcds_q88/datafusion:parquet 86742900 / 86047137 / +0.8% 114661280 / 108358632 / +5.8% 0.76 / 0.79 / -4.7%
tpcds_q89/datafusion:parquet 39177210 / 38401756 / +2.0% 64849982 / 64923770 / -0.1% 0.60 / 0.59 / +2.1%
tpcds_q90/datafusion:parquet 17465169 / 18100802 / -3.5% 34023009 / 32273520 / +5.4% 0.51 / 0.56 / -8.5%
tpcds_q91/datafusion:parquet 42498912 / 41738000 / +1.8% 58792429 / 57454843 / +2.3% 0.72 / 0.73 / -0.5%
tpcds_q92/datafusion:parquet 28668370 / 28604120 / +0.2% 47527179 / 47460689 / +0.1% 0.60 / 0.60 / +0.1%
tpcds_q93/datafusion:parquet 59579622 / 63722030 / -6.5% 90445762 / 87405909 / +3.5% 0.66 / 0.73 / -9.6%
tpcds_q94/datafusion:parquet 38937870 / 37847109 / +2.9% 57541167 / 58549059 / -1.7% 0.68 / 0.65 / +4.7%
tpcds_q95/datafusion:parquet 126376244 / 128012922 / -1.3% 155312234 / 149910916 / +3.6% 0.81 / 0.85 / -4.7%
tpcds_q96/datafusion:parquet 20386217 / 20691258 / -1.5% 36648070 / 36951345 / -0.8% 0.56 / 0.56 / -0.7%
tpcds_q97/datafusion:parquet 54515698 / 54645566 / -0.2% 79977348 / 80351616 / -0.5% 0.68 / 0.68 / +0.2%
tpcds_q98/datafusion:parquet 60978348 / 61965680 / -1.6% 82819050 / 83775704 / -1.1% 0.74 / 0.74 / -0.5%
tpcds_q99/datafusion:parquet 42571002 / 42461627 / +0.3% 58100796 / 57802802 / +0.5% 0.73 / 0.73 / -0.3%
duckdb / vortex-file-compressed / ns (1.001x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32871814 / 32726779 / +0.4% 45159542 / 45377689 / -0.5% 0.73 / 0.72 / +0.9%
tpcds_q02/duckdb:vortex-file-compressed 30352910 / 30267290 / +0.3% 41048247 / 44087004 / -6.9% 0.74 / 0.69 / +7.7%
tpcds_q03/duckdb:vortex-file-compressed 13797228 / 13779130 / +0.1% 29306057 / 30718899 / -4.6% 0.47 / 0.45 / +5.0%
tpcds_q04/duckdb:vortex-file-compressed 127865299 / 130206338 / -1.8% 148043340 / 157201556 / -5.8% 0.86 / 0.83 / +4.3%
tpcds_q05/duckdb:vortex-file-compressed 55399868 / 53727511 / +3.1% 82293472 / 83478676 / -1.4% 0.67 / 0.64 / +4.6%
tpcds_q06/duckdb:vortex-file-compressed 58684634 / 58800986 / -0.2% 78649490 / 79094008 / -0.6% 0.75 / 0.74 / +0.4%
tpcds_q07/duckdb:vortex-file-compressed 31009452 / 31168844 / -0.5% 51798712 / 54099517 / -4.3% 0.60 / 0.58 / +3.9%
tpcds_q08/duckdb:vortex-file-compressed 31089896 / 31134683 / -0.1% 41117576 / 41772800 / -1.6% 0.76 / 0.75 / +1.4%
tpcds_q09/duckdb:vortex-file-compressed 56377600 / 55235330 / +2.1% 78409026 / 79107779 / -0.9% 0.72 / 0.70 / +3.0%
tpcds_q10/duckdb:vortex-file-compressed 39307246 / 39038430 / +0.7% 57349710 / 58236826 / -1.5% 0.69 / 0.67 / +2.2%
tpcds_q11/duckdb:vortex-file-compressed 95452024 / 96226126 / -0.8% 109762684 / 112266994 / -2.2% 0.87 / 0.86 / +1.5%
tpcds_q12/duckdb:vortex-file-compressed 17315706 / 17276975 / +0.2% 28300316 / 30254952 / -6.5% 0.61 / 0.57 / +7.1%
tpcds_q13/duckdb:vortex-file-compressed 38521773 / 38940578 / -1.1% 70406228 / 71103229 / -1.0% 0.55 / 0.55 / -0.1%
tpcds_q14/duckdb:vortex-file-compressed 115034088 / 119983268 / -4.1% 138891524 / 140641737 / -1.2% 0.83 / 0.85 / -2.9%
tpcds_q15/duckdb:vortex-file-compressed 60870244 / 60759281 / +0.2% 70710930 / 76171754 / -7.2% 0.86 / 0.80 / +7.9%
tpcds_q16/duckdb:vortex-file-compressed 34413966 / 34771337 / -1.0% 53830664 / 53890958 / -0.1% 0.64 / 0.65 / -0.9%
tpcds_q17/duckdb:vortex-file-compressed 57411714 / 57289182 / +0.2% 79111529 / 81955246 / -3.5% 0.73 / 0.70 / +3.8%
tpcds_q18/duckdb:vortex-file-compressed 82532378 / 82993345 / -0.6% 103241141 / 104424434 / -1.1% 0.80 / 0.79 / +0.6%
tpcds_q19/duckdb:vortex-file-compressed 45048766 / 43899722 / +2.6% 62829615 / 65276395 / -3.7% 0.72 / 0.67 / +6.6%
tpcds_q20/duckdb:vortex-file-compressed 22062044 / 21520304 / +2.5% 36254131 / 34931964 / +3.8% 0.61 / 0.62 / -1.2%
tpcds_q21/duckdb:vortex-file-compressed 27803370 / 28120830 / -1.1% 59569258 / 62004166 / -3.9% 0.47 / 0.45 / +2.9%
tpcds_q22/duckdb:vortex-file-compressed 164024805 / 165099230 / -0.7% 175766161 / 170541662 / +3.1% 0.93 / 0.97 / -3.6%
tpcds_q23/duckdb:vortex-file-compressed 182317564 / 185876490 / -1.9% 203890655 / 199673618 / +2.1% 0.89 / 0.93 / -3.9%
tpcds_q24/duckdb:vortex-file-compressed 53024776 / 52636914 / +0.7% 75474398 / 77254623 / -2.3% 0.70 / 0.68 / +3.1%
tpcds_q25/duckdb:vortex-file-compressed 53887223 / 53220034 / +1.3% 75249361 / 75302591 / -0.1% 0.72 / 0.71 / +1.3%
tpcds_q26/duckdb:vortex-file-compressed 25597101 / 26713063 / -4.2% 40723098 / 42934826 / -5.2% 0.63 / 0.62 / +1.0%
tpcds_q27/duckdb:vortex-file-compressed 31907618 / 32585874 / -2.1% 53338270 / 53424233 / -0.2% 0.60 / 0.61 / -1.9%
tpcds_q28/duckdb:vortex-file-compressed 42381254 / 41342696 / +2.5% 64640220 / 66089322 / -2.2% 0.66 / 0.63 / +4.8%
tpcds_q29/duckdb:vortex-file-compressed 52694944 / 51866994 / +1.6% 73762145 / 74066949 / -0.4% 0.71 / 0.70 / +2.0%
tpcds_q30/duckdb:vortex-file-compressed 38442283 / 37914817 / +1.4% 51071124 / 52960815 / -3.6% 0.75 / 0.72 / +5.1%
tpcds_q31/duckdb:vortex-file-compressed 37870785 / 37512062 / +1.0% 56258945 / 53392186 / +5.4% 0.67 / 0.70 / -4.2%
tpcds_q32/duckdb:vortex-file-compressed 14016924 / 13855892 / +1.2% 29328585 / 28855272 / +1.6% 0.48 / 0.48 / -0.5%
tpcds_q33/duckdb:vortex-file-compressed 33509090 / 33813963 / -0.9% 58520572 / 59046480 / -0.9% 0.57 / 0.57 / -0.0%
tpcds_q34/duckdb:vortex-file-compressed 23107721 / 22811725 / +1.3% 39404183 / 39776812 / -0.9% 0.59 / 0.57 / +2.3%
tpcds_q35/duckdb:vortex-file-compressed 67426446 / 66786588 / +1.0% 87970047 / 85242000 / +3.2% 0.77 / 0.78 / -2.2%
tpcds_q36/duckdb:vortex-file-compressed 29138838 / 29806828 / -2.2% 46813348 / 49308472 / -5.1% 0.62 / 0.60 / +3.0%
tpcds_q37/duckdb:vortex-file-compressed 25392398 / 25605208 / -0.8% 74502916 / 74457214 / +0.1% 0.34 / 0.34 / -0.9%
tpcds_q38/duckdb:vortex-file-compressed 60612261 / 62408870 / -2.9% 72743377 / 81156842 / -10.4% 🟢 0.83 / 0.77 / +8.4%
tpcds_q39/duckdb:vortex-file-compressed 54589625 / 56168904 / -2.8% 83959201 / 85127364 / -1.4% 0.65 / 0.66 / -1.5%
tpcds_q40/duckdb:vortex-file-compressed 19213337 / 19238372 / -0.1% 34592893 / 35099919 / -1.4% 0.56 / 0.55 / +1.3%
tpcds_q41/duckdb:vortex-file-compressed 19344802 / 18720698 / +3.3% 25510382 / 25500417 / +0.0% 0.76 / 0.73 / +3.3%
tpcds_q42/duckdb:vortex-file-compressed 14201661 / 14015144 / +1.3% 30735964 / 30966847 / -0.7% 0.46 / 0.45 / +2.1%
tpcds_q43/duckdb:vortex-file-compressed 19717586 / 19403602 / +1.6% 36439650 / 32011378 / +13.8% 🔴 0.54 / 0.61 / -10.7%
tpcds_q44/duckdb:vortex-file-compressed 28098281 / 28307018 / -0.7% 50429038 / 51668551 / -2.4% 0.56 / 0.55 / +1.7%
tpcds_q45/duckdb:vortex-file-compressed 46110617 / 46586273 / -1.0% 59994070 / 60370446 / -0.6% 0.77 / 0.77 / -0.4%
tpcds_q46/duckdb:vortex-file-compressed 51174036 / 51192653 / -0.0% 75812446 / 75043524 / +1.0% 0.68 / 0.68 / -1.1%
tpcds_q47/duckdb:vortex-file-compressed 80666670 / 80927444 / -0.3% 94696626 / 97094785 / -2.5% 0.85 / 0.83 / +2.2%
tpcds_q48/duckdb:vortex-file-compressed 53165810 / 53155386 / +0.0% 80137981 / 81823473 / -2.1% 0.66 / 0.65 / +2.1%
tpcds_q49/duckdb:vortex-file-compressed 38715812 / 37950044 / +2.0% 77905044 / 78847393 / -1.2% 0.50 / 0.48 / +3.3%
tpcds_q50/duckdb:vortex-file-compressed 32358157 / 32675461 / -1.0% 56318024 / 57051911 / -1.3% 0.57 / 0.57 / +0.3%
tpcds_q51/duckdb:vortex-file-compressed 204124797 / 204779876 / -0.3% 219692638 / 217736852 / +0.9% 0.93 / 0.94 / -1.2%
tpcds_q52/duckdb:vortex-file-compressed 14935784 / 15384257 / -2.9% 31437500 / 31876748 / -1.4% 0.48 / 0.48 / -1.6%
tpcds_q53/duckdb:vortex-file-compressed 22033323 / 22960290 / -4.0% 37505370 / 39000657 / -3.8% 0.59 / 0.59 / -0.2%
tpcds_q54/duckdb:vortex-file-compressed 44470488 / 44886930 / -0.9% 64360585 / 65481173 / -1.7% 0.69 / 0.69 / +0.8%
tpcds_q55/duckdb:vortex-file-compressed 15079000 / 14612501 / +3.2% 29981406 / 30570651 / -1.9% 0.50 / 0.48 / +5.2%
tpcds_q56/duckdb:vortex-file-compressed 32896339 / 32462078 / +1.3% 55235853 / 57717193 / -4.3% 0.60 / 0.56 / +5.9%
tpcds_q57/duckdb:vortex-file-compressed 71380731 / 64171452 / +11.2% 🔴 78113230 / 78496038 / -0.5% 0.91 / 0.82 / +11.8%
tpcds_q58/duckdb:vortex-file-compressed 37917446 / 37835588 / +0.2% 58802048 / 64016051 / -8.1% 0.64 / 0.59 / +9.1%
tpcds_q59/duckdb:vortex-file-compressed 53069289 / 53810956 / -1.4% 69726372 / 71107629 / -1.9% 0.76 / 0.76 / +0.6%
tpcds_q60/duckdb:vortex-file-compressed 34810048 / 35369636 / -1.6% 58752019 / 59793701 / -1.7% 0.59 / 0.59 / +0.2%
tpcds_q61/duckdb:vortex-file-compressed 35171762 / 34298255 / +2.5% 52083480 / 53069753 / -1.9% 0.68 / 0.65 / +4.5%
tpcds_q62/duckdb:vortex-file-compressed 18136966 / 14822514 / +22.4% 🔴 26677581 / 26421769 / +1.0% 0.68 / 0.56 / +21.2%
tpcds_q63/duckdb:vortex-file-compressed 21238334 / 20828409 / +2.0% 36642521 / 38114655 / -3.9% 0.58 / 0.55 / +6.1%
tpcds_q64/duckdb:vortex-file-compressed 118989667 / 118342334 / +0.5% 152007626 / 152181613 / -0.1% 0.78 / 0.78 / +0.7%
tpcds_q65/duckdb:vortex-file-compressed 51873658 / 51466061 / +0.8% 66620391 / 58907342 / +13.1% 🔴 0.78 / 0.87 / -10.9%
tpcds_q66/duckdb:vortex-file-compressed 41385516 / 40998564 / +0.9% 57436318 / 58858579 / -2.4% 0.72 / 0.70 / +3.4%
tpcds_q67/duckdb:vortex-file-compressed 272637998 / 277425812 / -1.7% 280740600 / 283678837 / -1.0% 0.97 / 0.98 / -0.7%
tpcds_q68/duckdb:vortex-file-compressed 43712053 / 44593714 / -2.0% 72419589 / 72079771 / +0.5% 0.60 / 0.62 / -2.4%
tpcds_q69/duckdb:vortex-file-compressed 37822464 / 38356528 / -1.4% 59702322 / 59755970 / -0.1% 0.63 / 0.64 / -1.3%
tpcds_q70/duckdb:vortex-file-compressed 25207296 / 25085070 / +0.5% 41422245 / 41516746 / -0.2% 0.61 / 0.60 / +0.7%
tpcds_q71/duckdb:vortex-file-compressed 28252824 / 27715436 / +1.9% 51471165 / 50902781 / +1.1% 0.55 / 0.54 / +0.8%
tpcds_q72/duckdb:vortex-file-compressed 138833882 / 135900823 / +2.2% 162462212 / 164226936 / -1.1% 0.85 / 0.83 / +3.3%
tpcds_q73/duckdb:vortex-file-compressed 19956702 / 20089200 / -0.7% 35705837 / 37315276 / -4.3% 0.56 / 0.54 / +3.8%
tpcds_q74/duckdb:vortex-file-compressed 84295518 / 82722980 / +1.9% 99828979 / 99629718 / +0.2% 0.84 / 0.83 / +1.7%
tpcds_q75/duckdb:vortex-file-compressed 111088150 / 111929736 / -0.8% 140475153 / 139908352 / +0.4% 0.79 / 0.80 / -1.2%
tpcds_q76/duckdb:vortex-file-compressed 28097961 / 27219565 / +3.2% 55371696 / 58492855 / -5.3% 0.51 / 0.47 / +9.0%
tpcds_q77/duckdb:vortex-file-compressed 36609936 / 36316546 / +0.8% 59244719 / 62103115 / -4.6% 0.62 / 0.58 / +5.7%
tpcds_q78/duckdb:vortex-file-compressed 134609135 / 137442428 / -2.1% 157023140 / 159793923 / -1.7% 0.86 / 0.86 / -0.3%
tpcds_q79/duckdb:vortex-file-compressed 37376214 / 37665982 / -0.8% 62249343 / 59874325 / +4.0% 0.60 / 0.63 / -4.6%
tpcds_q80/duckdb:vortex-file-compressed 58444887 / 57541290 / +1.6% 88322226 / 89399248 / -1.2% 0.66 / 0.64 / +2.8%
tpcds_q81/duckdb:vortex-file-compressed 57335611 / 57777750 / -0.8% 71556866 / 71231569 / +0.5% 0.80 / 0.81 / -1.2%
tpcds_q82/duckdb:vortex-file-compressed 27229035 / 26860434 / +1.4% 76518724 / 77804956 / -1.7% 0.36 / 0.35 / +3.1%
tpcds_q83/duckdb:vortex-file-compressed 21809054 / 21694036 / +0.5% 31434826 / 32263861 / -2.6% 0.69 / 0.67 / +3.2%
tpcds_q84/duckdb:vortex-file-compressed 13638072 / 13366814 / +2.0% 23766910 / 23226339 / +2.3% 0.57 / 0.58 / -0.3%
tpcds_q85/duckdb:vortex-file-compressed 36636897 / 36707151 / -0.2% 56135964 / 56348206 / -0.4% 0.65 / 0.65 / +0.2%
tpcds_q86/duckdb:vortex-file-compressed 17081980 / 16411782 / +4.1% 27675032 / 28182293 / -1.8% 0.62 / 0.58 / +6.0%
tpcds_q87/duckdb:vortex-file-compressed 76775176 / 75201770 / +2.1% 88648264 / 87749398 / +1.0% 0.87 / 0.86 / +1.1%
tpcds_q88/duckdb:vortex-file-compressed 38129510 / 37878092 / +0.7% 50175634 / 49979733 / +0.4% 0.76 / 0.76 / +0.3%
tpcds_q89/duckdb:vortex-file-compressed 24872310 / 24974289 / -0.4% 41526035 / 41888285 / -0.9% 0.60 / 0.60 / +0.5%
tpcds_q90/duckdb:vortex-file-compressed 9894744 / 9843474 / +0.5% 20560102 / 20353435 / +1.0% 0.48 / 0.48 / -0.5%
tpcds_q91/duckdb:vortex-file-compressed 19494045 / 19617013 / -0.6% 27802274 / 29081972 / -4.4% 0.70 / 0.67 / +3.9%
tpcds_q92/duckdb:vortex-file-compressed 13413162 / 13643566 / -1.7% 27797337 / 27682975 / +0.4% 0.48 / 0.49 / -2.1%
tpcds_q93/duckdb:vortex-file-compressed 25562332 / 25876894 / -1.2% 52843299 / 52613864 / +0.4% 0.48 / 0.49 / -1.6%
tpcds_q94/duckdb:vortex-file-compressed 32152188 / 32152022 / +0.0% 47248883 / 47204449 / +0.1% 0.68 / 0.68 / -0.1%
tpcds_q95/duckdb:vortex-file-compressed 94701879 / 97513786 / -2.9% 102805500 / 117615692 / -12.6% 🟢 0.92 / 0.83 / +11.1%
tpcds_q96/duckdb:vortex-file-compressed 12279356 / 11752061 / +4.5% 24191599 / 24570663 / -1.5% 0.51 / 0.48 / +6.1%
tpcds_q97/duckdb:vortex-file-compressed 60562008 / 62178961 / -2.6% 79151043 / 82766588 / -4.4% 0.77 / 0.75 / +1.8%
tpcds_q98/duckdb:vortex-file-compressed 27311356 / 26889542 / +1.6% 41616079 / 43917859 / -5.2% 0.66 / 0.61 / +7.2%
tpcds_q99/duckdb:vortex-file-compressed 20226350 / 26072871 / -22.4% 🟢 35667083 / 35980286 / -0.9% 0.57 / 0.72 / -21.7%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 44280146 / 43748750 / +1.2% 50935666 / 50433867 / +1.0% 0.87 / 0.87 / +0.2%
tpcds_q02/duckdb:parquet 39509661 / 39630168 / -0.3% 46361336 / 50715675 / -8.6% 0.85 / 0.78 / +9.1%
tpcds_q03/duckdb:parquet 25130872 / 25995732 / -3.3% 37565738 / 36796166 / +2.1% 0.67 / 0.71 / -5.3%
tpcds_q04/duckdb:parquet 206033450 / 203957459 / +1.0% 226135248 / 234181220 / -3.4% 0.91 / 0.87 / +4.6%
tpcds_q05/duckdb:parquet 69828870 / 68357342 / +2.2% 89275518 / 87464497 / +2.1% 0.78 / 0.78 / +0.1%
tpcds_q06/duckdb:parquet 75014010 / 75115975 / -0.1% 88476119 / 89166769 / -0.8% 0.85 / 0.84 / +0.6%
tpcds_q07/duckdb:parquet 60214312 / 62193874 / -3.2% 75574598 / 76707973 / -1.5% 0.80 / 0.81 / -1.7%
tpcds_q08/duckdb:parquet 39041660 / 38663366 / +1.0% 45155229 / 46394278 / -2.7% 0.86 / 0.83 / +3.7%
tpcds_q09/duckdb:parquet 85870648 / 87080988 / -1.4% 96333343 / 101981323 / -5.5% 0.89 / 0.85 / +4.4%
tpcds_q10/duckdb:parquet 52276332 / 52520572 / -0.5% 62653332 / 62695229 / -0.1% 0.83 / 0.84 / -0.4%
tpcds_q11/duckdb:parquet 157380079 / 159415788 / -1.3% 169230976 / 164104249 / +3.1% 0.93 / 0.97 / -4.3%
tpcds_q12/duckdb:parquet 40643514 / 40814548 / -0.4% 47106107 / 48941959 / -3.8% 0.86 / 0.83 / +3.5%
tpcds_q13/duckdb:parquet 71241874 / 69804706 / +2.1% 89136308 / 87793121 / +1.5% 0.80 / 0.80 / +0.5%
tpcds_q14/duckdb:parquet 184424575 / 185753765 / -0.7% 200959853 / 202864595 / -0.9% 0.92 / 0.92 / +0.2%
tpcds_q15/duckdb:parquet 60935258 / 60934452 / +0.0% 68665704 / 69050398 / -0.6% 0.89 / 0.88 / +0.6%
tpcds_q16/duckdb:parquet 37940378 / 37850674 / +0.2% 46700867 / 45839434 / +1.9% 0.81 / 0.83 / -1.6%
tpcds_q17/duckdb:parquet 83144078 / 84076050 / -1.1% 90996787 / 89860905 / +1.3% 0.91 / 0.94 / -2.3%
tpcds_q18/duckdb:parquet 87721264 / 87775860 / -0.1% 96608098 / 98136096 / -1.6% 0.91 / 0.89 / +1.5%
tpcds_q19/duckdb:parquet 48053869 / 47466565 / +1.2% 58903931 / 63007623 / -6.5% 0.82 / 0.75 / +8.3%
tpcds_q20/duckdb:parquet 42285240 / 42342882 / -0.1% 52924261 / 48573403 / +9.0% 0.80 / 0.87 / -8.3%
tpcds_q21/duckdb:parquet 23839488 / 23962194 / -0.5% 28412799 / 28440652 / -0.1% 0.84 / 0.84 / -0.4%
tpcds_q22/duckdb:parquet 167513827 / 166072912 / +0.9% 166013468 / 167098902 / -0.6% 1.01 / 0.99 / +1.5%
tpcds_q23/duckdb:parquet 185053886 / 188036546 / -1.6% 193871810 / 193148517 / +0.4% 0.95 / 0.97 / -2.0%
tpcds_q24/duckdb:parquet 72649750 / 71146241 / +2.1% 82019434 / 82487151 / -0.6% 0.89 / 0.86 / +2.7%
tpcds_q25/duckdb:parquet 50797721 / 51215258 / -0.8% 60591327 / 61288817 / -1.1% 0.84 / 0.84 / +0.3%
tpcds_q26/duckdb:parquet 42646995 / 42361802 / +0.7% 51728774 / 51343370 / +0.8% 0.82 / 0.83 / -0.1%
tpcds_q27/duckdb:parquet 58294596 / 57111037 / +2.1% 70430869 / 81608147 / -13.7% 🟢 0.83 / 0.70 / +18.3%
tpcds_q28/duckdb:parquet 92822379 / 93252698 / -0.5% 106880293 / 112178597 / -4.7% 0.87 / 0.83 / +4.5%
tpcds_q29/duckdb:parquet 83588020 / 83041768 / +0.7% 97378240 / 96583021 / +0.8% 0.86 / 0.86 / -0.2%
tpcds_q30/duckdb:parquet 72897347 / 72470468 / +0.6% 80946464 / 81148208 / -0.2% 0.90 / 0.89 / +0.8%
tpcds_q31/duckdb:parquet 98720004 / 98601462 / +0.1% 109908062 / 111465299 / -1.4% 0.90 / 0.88 / +1.5%
tpcds_q32/duckdb:parquet 18066280 / 18353748 / -1.6% 25208747 / 26590155 / -5.2% 0.72 / 0.69 / +3.8%
tpcds_q33/duckdb:parquet 61807827 / 62367010 / -0.9% 72176780 / 73989561 / -2.5% 0.86 / 0.84 / +1.6%
tpcds_q34/duckdb:parquet 31920274 / 33006494 / -3.3% 41942412 / 41889230 / +0.1% 0.76 / 0.79 / -3.4%
tpcds_q35/duckdb:parquet 76413658 / 77399391 / -1.3% 86339895 / 86087567 / +0.3% 0.89 / 0.90 / -1.6%
tpcds_q36/duckdb:parquet 98835332 / 99335950 / -0.5% 110911813 / 112263590 / -1.2% 0.89 / 0.88 / +0.7%
tpcds_q37/duckdb:parquet 41762906 / 41378236 / +0.9% 49279494 / 47554095 / +3.6% 0.85 / 0.87 / -2.6%
tpcds_q38/duckdb:parquet 75345846 / 76468258 / -1.5% 80651101 / 85294747 / -5.4% 0.93 / 0.90 / +4.2%
tpcds_q39/duckdb:parquet 61734170 / 61661639 / +0.1% 67619901 / 67797634 / -0.3% 0.91 / 0.91 / +0.4%
tpcds_q40/duckdb:parquet 28054460 / 27952642 / +0.4% 35719982 / 36118029 / -1.1% 0.79 / 0.77 / +1.5%
tpcds_q41/duckdb:parquet 20634128 / 20143537 / +2.4% 26417518 / 26266476 / +0.6% 0.78 / 0.77 / +1.8%
tpcds_q42/duckdb:parquet 26446925 / 26999602 / -2.0% 38521283 / 36451419 / +5.7% 0.69 / 0.74 / -7.3%
tpcds_q43/duckdb:parquet 27152666 / 28272378 / -4.0% 33643095 / 35793884 / -6.0% 0.81 / 0.79 / +2.2%
tpcds_q44/duckdb:parquet 62328592 / 60736375 / +2.6% 70609688 / 74562633 / -5.3% 0.88 / 0.81 / +8.4%
tpcds_q45/duckdb:parquet 61342036 / 60622120 / +1.2% 69005232 / 67027287 / +3.0% 0.89 / 0.90 / -1.7%
tpcds_q46/duckdb:parquet 74404340 / 72394963 / +2.8% 88631172 / 88023341 / +0.7% 0.84 / 0.82 / +2.1%
tpcds_q47/duckdb:parquet 90107433 / 90830810 / -0.8% 105410135 / 105146923 / +0.3% 0.85 / 0.86 / -1.0%
tpcds_q48/duckdb:parquet 66563382 / 67648746 / -1.6% 85073890 / 85359866 / -0.3% 0.78 / 0.79 / -1.3%
tpcds_q49/duckdb:parquet 67529303 / 67399774 / +0.2% 91101391 / 92020170 / -1.0% 0.74 / 0.73 / +1.2%
tpcds_q50/duckdb:parquet 43496802 / 45228659 / -3.8% 54195339 / 50910629 / +6.5% 0.80 / 0.89 / -9.7%
tpcds_q51/duckdb:parquet 217244573 / 217340788 / -0.0% 220216131 / 225257376 / -2.2% 0.99 / 0.96 / +2.2%
tpcds_q52/duckdb:parquet 27350908 / 26490668 / +3.2% 36289431 / 37218058 / -2.5% 0.75 / 0.71 / +5.9%
tpcds_q53/duckdb:parquet 33653875 / 34202255 / -1.6% 52459009 / 48232701 / +8.8% 0.64 / 0.71 / -9.5%
tpcds_q54/duckdb:parquet 56221187 / 55357348 / +1.6% 64137006 / 63307482 / +1.3% 0.88 / 0.87 / +0.2%
tpcds_q55/duckdb:parquet 26196880 / 26580602 / -1.4% 39434523 / 38734658 / +1.8% 0.66 / 0.69 / -3.2%
tpcds_q56/duckdb:parquet 67514262 / 68450543 / -1.4% 77070633 / 84208264 / -8.5% 0.88 / 0.81 / +7.8%
tpcds_q57/duckdb:parquet 68108444 / 67905272 / +0.3% 75615704 / 75530496 / +0.1% 0.90 / 0.90 / +0.2%
tpcds_q58/duckdb:parquet 55440616 / 55351262 / +0.2% 68182323 / 67300961 / +1.3% 0.81 / 0.82 / -1.1%
tpcds_q59/duckdb:parquet 61150106 / 61543058 / -0.6% 66589063 / 67498896 / -1.3% 0.92 / 0.91 / +0.7%
tpcds_q60/duckdb:parquet 81463977 / 81154691 / +0.4% 93780337 / 95719978 / -2.0% 0.87 / 0.85 / +2.5%
tpcds_q61/duckdb:parquet 79694560 / 78725636 / +1.2% 93026301 / 94693948 / -1.8% 0.86 / 0.83 / +3.0%
tpcds_q62/duckdb:parquet 20200711 / 21271646 / -5.0% 26624220 / 24742108 / +7.6% 0.76 / 0.86 / -11.7%
tpcds_q63/duckdb:parquet 34144738 / 33973322 / +0.5% 44392197 / 44293841 / +0.2% 0.77 / 0.77 / +0.3%
tpcds_q64/duckdb:parquet 136291911 / 134987804 / +1.0% 153746431 / 149714203 / +2.7% 0.89 / 0.90 / -1.7%
tpcds_q65/duckdb:parquet 97396832 / 92507762 / +5.3% 95318898 / 106732283 / -10.7% 🟢 1.02 / 0.87 / +17.9%
tpcds_q66/duckdb:parquet 48062790 / 45574203 / +5.5% 55291828 / 52408182 / +5.5% 0.87 / 0.87 / -0.0%
tpcds_q67/duckdb:parquet 295038836 / 294181831 / +0.3% 296689929 / 294225942 / +0.8% 0.99 / 1.00 / -0.5%
tpcds_q68/duckdb:parquet 61261197 / 61610444 / -0.6% 77415153 / 77643526 / -0.3% 0.79 / 0.79 / -0.3%
tpcds_q69/duckdb:parquet 66330886 / 65821270 / +0.8% 74436478 / 75369095 / -1.2% 0.89 / 0.87 / +2.0%
tpcds_q70/duckdb:parquet 43176796 / 42560156 / +1.4% 50723756 / 50824609 / -0.2% 0.85 / 0.84 / +1.7%
tpcds_q71/duckdb:parquet 42015896 / 41353862 / +1.6% 52569717 / 54241063 / -3.1% 0.80 / 0.76 / +4.8%
tpcds_q72/duckdb:parquet 172283546 / 172146606 / +0.1% 182406194 / 189350126 / -3.7% 0.94 / 0.91 / +3.9%
tpcds_q73/duckdb:parquet 28322558 / 27072398 / +4.6% 37590739 / 37030456 / +1.5% 0.75 / 0.73 / +3.1%
tpcds_q74/duckdb:parquet 215049302 / 216089249 / -0.5% 224654193 / 223017657 / +0.7% 0.96 / 0.97 / -1.2%
tpcds_q75/duckdb:parquet 134038988 / 131891024 / +1.6% 149095149 / 152249842 / -2.1% 0.90 / 0.87 / +3.8%
tpcds_q76/duckdb:parquet 52444290 / 51285484 / +2.3% 74428150 / 65205448 / +14.1% 🔴 0.70 / 0.79 / -10.4%
tpcds_q77/duckdb:parquet 54757416 / 54841040 / -0.2% 68398768 / 67440836 / +1.4% 0.80 / 0.81 / -1.6%
tpcds_q78/duckdb:parquet 148968924 / 155747874 / -4.4% 162444522 / 168363678 / -3.5% 0.92 / 0.93 / -0.9%
tpcds_q79/duckdb:parquet 56296112 / 51430181 / +9.5% 68063081 / 64568583 / +5.4% 0.83 / 0.80 / +3.8%
tpcds_q80/duckdb:parquet 82077980 / 82941310 / -1.0% 102819998 / 103690804 / -0.8% 0.80 / 0.80 / -0.2%
tpcds_q81/duckdb:parquet 97710254 / 98572923 / -0.9% 105202314 / 104274293 / +0.9% 0.93 / 0.95 / -1.7%
tpcds_q82/duckdb:parquet 45663343 / 46604344 / -2.0% 53675601 / 52315928 / +2.6% 0.85 / 0.89 / -4.5%
tpcds_q83/duckdb:parquet 27755063 / 28152398 / -1.4% 33432312 / 33185714 / +0.7% 0.83 / 0.85 / -2.1%
tpcds_q84/duckdb:parquet 22630130 / 22751552 / -0.5% 29508487 / 29406408 / +0.3% 0.77 / 0.77 / -0.9%
tpcds_q85/duckdb:parquet 51588676 / 52752074 / -2.2% 61583803 / 62960389 / -2.2% 0.84 / 0.84 / -0.0%
tpcds_q86/duckdb:parquet 24366408 / 25146913 / -3.1% 32807553 / 33004413 / -0.6% 0.74 / 0.76 / -2.5%
tpcds_q87/duckdb:parquet 85855340 / 88695797 / -3.2% 98460948 / 92564858 / +6.4% 0.87 / 0.96 / -9.0%
tpcds_q88/duckdb:parquet 103919132 / 106796080 / -2.7% 112204435 / 111229279 / +0.9% 0.93 / 0.96 / -3.5%
tpcds_q89/duckdb:parquet 37116182 / 37846748 / -1.9% 47049349 / 48196620 / -2.4% 0.79 / 0.79 / +0.5%
tpcds_q90/duckdb:parquet 15775842 / 15015242 / +5.1% 22056604 / 20928242 / +5.4% 0.72 / 0.72 / -0.3%
tpcds_q91/duckdb:parquet 25520318 / 25515043 / +0.0% 33171163 / 33274247 / -0.3% 0.77 / 0.77 / +0.3%
tpcds_q92/duckdb:parquet 22447786 / 22329364 / +0.5% 30202731 / 31995562 / -5.6% 0.74 / 0.70 / +6.5%
tpcds_q93/duckdb:parquet 37504978 / 35799040 / +4.8% 49216987 / 49479404 / -0.5% 0.76 / 0.72 / +5.3%
tpcds_q94/duckdb:parquet 39421811 / 38247234 / +3.1% 45719313 / 46965479 / -2.7% 0.86 / 0.81 / +5.9%
tpcds_q95/duckdb:parquet 84132167 / 81409130 / +3.3% 87128414 / 86595751 / +0.6% 0.97 / 0.94 / +2.7%
tpcds_q96/duckdb:parquet 17961542 / 17012262 / +5.6% 24732939 / 24425947 / +1.3% 0.73 / 0.70 / +4.3%
tpcds_q97/duckdb:parquet 72413302 / 73153984 / -1.0% 86249042 / 78153554 / +10.4% 🔴 0.84 / 0.94 / -10.3%
tpcds_q98/duckdb:parquet 54613792 / 55289756 / -1.2% 68085994 / 66788134 / +1.9% 0.80 / 0.83 / -3.1%
tpcds_q99/duckdb:parquet 25841132 / 24402862 / +5.9% 33155238 / 30438057 / +8.9% 0.78 / 0.80 / -2.8%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 6e7759e9 vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+7.1%, environment too noisy confidence) · DuckDB No clear signal (-4.2%, environment too noisy confidence)
Vortex (geomean): hot 1.044x ➖ · cold 1.017x ➖
Parquet (geomean): hot 1.031x ➖ · cold 1.055x ➖
Shifts: Parquet (control) +3.1% · Median polish +2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.093x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 212496589 / 213717821 / -0.6% 847459794 / 764398977 / +10.9% 0.25 / 0.28 / -10.3%
tpch_q02/datafusion:vortex-file-compressed 335889647 / 320984758 / +4.6% 734730611 / 553448858 / +32.8% 🔴 0.46 / 0.58 / -21.2%
tpch_q03/datafusion:vortex-file-compressed 408117321 / 310450262 / +31.5% 🔴 901956468 / 854530904 / +5.5% 0.45 / 0.36 / +24.5%
tpch_q04/datafusion:vortex-file-compressed 168320681 / 159007585 / +5.9% 375573534 / 372572808 / +0.8% 0.45 / 0.43 / +5.0%
tpch_q05/datafusion:vortex-file-compressed 359636946 / 344078558 / +4.5% 597225371 / 546047746 / +9.4% 0.60 / 0.63 / -4.4%
tpch_q06/datafusion:vortex-file-compressed 140663484 / 123668516 / +13.7% 291703037 / 317073449 / -8.0% 0.48 / 0.39 / +23.6%
tpch_q07/datafusion:vortex-file-compressed 432898223 / 426177142 / +1.6% 586698054 / 586012416 / +0.1% 0.74 / 0.73 / +1.5%
tpch_q08/datafusion:vortex-file-compressed 449142900 / 410714646 / +9.4% 666558150 / 541459260 / +23.1% 0.67 / 0.76 / -11.2%
tpch_q09/datafusion:vortex-file-compressed 311356057 / 301899395 / +3.1% 540039845 / 455403137 / +18.6% 0.58 / 0.66 / -13.0%
tpch_q10/datafusion:vortex-file-compressed 377028911 / 361036359 / +4.4% 565142294 / 525406226 / +7.6% 0.67 / 0.69 / -2.9%
tpch_q11/datafusion:vortex-file-compressed 472649906 / 272228443 / +73.6% 🔴 658640360 / 382260665 / +72.3% 🔴 0.72 / 0.71 / +0.8%
tpch_q12/datafusion:vortex-file-compressed 205872079 / 203460731 / +1.2% 367976657 / 338106908 / +8.8% 0.56 / 0.60 / -7.0%
tpch_q13/datafusion:vortex-file-compressed 115931906 / 116217877 / -0.2% 379060390 / 309114444 / +22.6% 0.31 / 0.38 / -18.7%
tpch_q14/datafusion:vortex-file-compressed 193837820 / 181074526 / +7.0% 310939021 / 354128334 / -12.2% 0.62 / 0.51 / +21.9%
tpch_q15/datafusion:vortex-file-compressed 337137843 / 306125584 / +10.1% 496955039 / 727209626 / -31.7% 🟢 0.68 / 0.42 / +61.2%
tpch_q16/datafusion:vortex-file-compressed 137062890 / 134848492 / +1.6% 276483562 / 285978767 / -3.3% 0.50 / 0.47 / +5.1%
tpch_q17/datafusion:vortex-file-compressed 259356334 / 252865916 / +2.6% 438988509 / 494400127 / -11.2% 0.59 / 0.51 / +15.5%
tpch_q18/datafusion:vortex-file-compressed 257258178 / 222278514 / +15.7% 444505340 / 389005809 / +14.3% 0.58 / 0.57 / +1.3%
tpch_q19/datafusion:vortex-file-compressed 258647609 / 226209017 / +14.3% 381527132 / 296515885 / +28.7% 0.68 / 0.76 / -11.1%
tpch_q20/datafusion:vortex-file-compressed 267846743 / 248686849 / +7.7% 439361185 / 477297666 / -7.9% 0.61 / 0.52 / +17.0%
tpch_q21/datafusion:vortex-file-compressed 402400229 / 384422617 / +4.7% 593589638 / 739838656 / -19.8% 0.68 / 0.52 / +30.5%
tpch_q22/datafusion:vortex-file-compressed 158193613 / 147475449 / +7.3% 451302941 / 337385924 / +33.8% 🔴 0.35 / 0.44 / -19.8%
datafusion / parquet / ns (1.021x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 150793277 / 143033960 / +5.4% 502748917 / 425422516 / +18.2% 0.30 / 0.34 / -10.8%
tpch_q02/datafusion:parquet 299422551 / 274389077 / +9.1% 534446007 / 421418541 / +26.8% 0.56 / 0.65 / -14.0%
tpch_q03/datafusion:parquet 253984972 / 240153039 / +5.8% 740926526 / 656104536 / +12.9% 0.34 / 0.37 / -6.3%
tpch_q04/datafusion:parquet 130119623 / 129091170 / +0.8% 328108465 / 262434371 / +25.0% 0.40 / 0.49 / -19.4%
tpch_q05/datafusion:parquet 326538158 / 325560808 / +0.3% 507070492 / 708712744 / -28.5% 0.64 / 0.46 / +40.2%
tpch_q06/datafusion:parquet 112910705 / 104623731 / +7.9% 225021692 / 202039421 / +11.4% 0.50 / 0.52 / -3.1%
tpch_q07/datafusion:parquet 330740573 / 326115720 / +1.4% 435556136 / 439408571 / -0.9% 0.76 / 0.74 / +2.3%
tpch_q08/datafusion:parquet 406879461 / 383031456 / +6.2% 518244905 / 487777150 / +6.2% 0.79 / 0.79 / -0.0%
tpch_q09/datafusion:parquet 379839726 / 507741508 / -25.2% 511393673 / 948722124 / -46.1% 🟢 0.74 / 0.54 / +38.8%
tpch_q10/datafusion:parquet 295449859 / 318225993 / -7.2% 444549869 / 431490793 / +3.0% 0.66 / 0.74 / -9.9%
tpch_q11/datafusion:parquet 251265014 / 245309101 / +2.4% 348259495 / 324804219 / +7.2% 0.72 / 0.76 / -4.5%
tpch_q12/datafusion:parquet 159201589 / 160703746 / -0.9% 282201585 / 262477140 / +7.5% 0.56 / 0.61 / -7.9%
tpch_q13/datafusion:parquet 268862620 / 274764633 / -2.1% 472238420 / 387802001 / +21.8% 0.57 / 0.71 / -19.6%
tpch_q14/datafusion:parquet 168653352 / 141590102 / +19.1% 340539886 / 264823133 / +28.6% 0.50 / 0.53 / -7.4%
tpch_q15/datafusion:parquet 307477941 / 297935495 / +3.2% 448121459 / 444599102 / +0.8% 0.69 / 0.67 / +2.4%
tpch_q16/datafusion:parquet 101412506 / 96864793 / +4.7% 191524388 / 207092637 / -7.5% 0.53 / 0.47 / +13.2%
tpch_q17/datafusion:parquet 274452921 / 268630342 / +2.2% 421140722 / 416939497 / +1.0% 0.65 / 0.64 / +1.1%
tpch_q18/datafusion:parquet 309242555 / 305302634 / +1.3% 505761873 / 465639400 / +8.6% 0.61 / 0.66 / -6.7%
tpch_q19/datafusion:parquet 157094231 / 149310744 / +5.2% 301466198 / 274137368 / +10.0% 0.52 / 0.54 / -4.3%
tpch_q20/datafusion:parquet 232488301 / 228071243 / +1.9% 415105047 / 424446687 / -2.2% 0.56 / 0.54 / +4.2%
tpch_q21/datafusion:parquet 304659528 / 291483866 / +4.5% 504199998 / 469762099 / +7.3% 0.60 / 0.62 / -2.6%
tpch_q22/datafusion:parquet 155243512 / 145366900 / +6.8% 350455306 / 299750221 / +16.9% 0.44 / 0.48 / -8.7%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 252193826 / 237695207 / +6.1% 298780266 / 298096331 / +0.2% 0.84 / 0.80 / +5.9%
tpch_q02/duckdb:vortex-file-compressed 415254842 / 394665672 / +5.2% 504516993 / 474795024 / +6.3% 0.82 / 0.83 / -1.0%
tpch_q03/duckdb:vortex-file-compressed 404998838 / 398939371 / +1.5% 456536931 / 460688509 / -0.9% 0.89 / 0.87 / +2.4%
tpch_q04/duckdb:vortex-file-compressed 268325839 / 255227345 / +5.1% 274401569 / 296337544 / -7.4% 0.98 / 0.86 / +13.5%
tpch_q05/duckdb:vortex-file-compressed 525746607 / 709957932 / -25.9% 599176532 / 785337665 / -23.7% 0.88 / 0.90 / -2.9%
tpch_q06/duckdb:vortex-file-compressed 160805181 / 148777224 / +8.1% 286929419 / 208058114 / +37.9% 🔴 0.56 / 0.72 / -21.6%
tpch_q07/duckdb:vortex-file-compressed 397547276 / 387859027 / +2.5% 459515800 / 510621725 / -10.0% 0.87 / 0.76 / +13.9%
tpch_q08/duckdb:vortex-file-compressed 594543310 / 617848086 / -3.8% 657447299 / 732855328 / -10.3% 0.90 / 0.84 / +7.3%
tpch_q09/duckdb:vortex-file-compressed 397158467 / 392528875 / +1.2% 480321377 / 482201706 / -0.4% 0.83 / 0.81 / +1.6%
tpch_q10/duckdb:vortex-file-compressed 530111474 / 526138612 / +0.8% 552835824 / 576801469 / -4.2% 0.96 / 0.91 / +5.1%
tpch_q11/duckdb:vortex-file-compressed 270631296 / 288496302 / -6.2% 287179788 / 270775100 / +6.1% 0.94 / 1.07 / -11.6%
tpch_q12/duckdb:vortex-file-compressed 245542466 / 271105721 / -9.4% 295249144 / 407392913 / -27.5% 0.83 / 0.67 / +25.0%
tpch_q13/duckdb:vortex-file-compressed 216825496 / 247871881 / -12.5% 214692193 / 208806747 / +2.8% 1.01 / 1.19 / -14.9%
tpch_q14/duckdb:vortex-file-compressed 217024541 / 224785869 / -3.5% 257861628 / 273953898 / -5.9% 0.84 / 0.82 / +2.6%
tpch_q15/duckdb:vortex-file-compressed 245200240 / 237917836 / +3.1% 288473181 / 453417020 / -36.4% 🟢 0.85 / 0.52 / +62.0%
tpch_q16/duckdb:vortex-file-compressed 190459606 / 206543544 / -7.8% 225275153 / 287344280 / -21.6% 0.85 / 0.72 / +17.6%
tpch_q17/duckdb:vortex-file-compressed 392745493 / 454602893 / -13.6% 342109006 / 443734007 / -22.9% 1.15 / 1.02 / +12.1%
tpch_q18/duckdb:vortex-file-compressed 392989490 / 339736454 / +15.7% 567797125 / 418339259 / +35.7% 🔴 0.69 / 0.81 / -14.8%
tpch_q19/duckdb:vortex-file-compressed 299323645 / 320978677 / -6.7% 361126751 / 349847295 / +3.2% 0.83 / 0.92 / -9.7%
tpch_q20/duckdb:vortex-file-compressed 527764218 / 334782469 / +57.6% 🔴 607103623 / 412936083 / +47.0% 🔴 0.87 / 0.81 / +7.2%
tpch_q21/duckdb:vortex-file-compressed 632422609 / 558602915 / +13.2% 630584028 / 630439819 / +0.0% 1.00 / 0.89 / +13.2%
tpch_q22/duckdb:vortex-file-compressed 220534669 / 253794094 / -13.1% 278618874 / 269551763 / +3.4% 0.79 / 0.94 / -15.9%
duckdb / parquet / ns (1.041x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 175179119 / 178327142 / -1.8% 218604431 / 188180852 / +16.2% 0.80 / 0.95 / -15.4%
tpch_q02/duckdb:parquet 411202250 / 428571834 / -4.1% 444274626 / 421258354 / +5.5% 0.93 / 1.02 / -9.0%
tpch_q03/duckdb:parquet 394380463 / 384797319 / +2.5% 437111930 / 402689855 / +8.5% 0.90 / 0.96 / -5.6%
tpch_q04/duckdb:parquet 257166893 / 278868438 / -7.8% 298233707 / 290411092 / +2.7% 0.86 / 0.96 / -10.2%
tpch_q05/duckdb:parquet 460515036 / 512960026 / -10.2% 535443494 / 589908823 / -9.2% 0.86 / 0.87 / -1.1%
tpch_q06/duckdb:parquet 210361488 / 154774655 / +35.9% 🔴 251355785 / 188086085 / +33.6% 🔴 0.84 / 0.82 / +1.7%
tpch_q07/duckdb:parquet 412091961 / 419672939 / -1.8% 427984643 / 421853390 / +1.5% 0.96 / 0.99 / -3.2%
tpch_q08/duckdb:parquet 568501480 / 588960652 / -3.5% 642258970 / 658661231 / -2.5% 0.89 / 0.89 / -1.0%
tpch_q09/duckdb:parquet 737042787 / 557378838 / +32.2% 🔴 781639579 / 656390425 / +19.1% 0.94 / 0.85 / +11.0%
tpch_q10/duckdb:parquet 583696283 / 517349035 / +12.8% 603810868 / 581884894 / +3.8% 0.97 / 0.89 / +8.7%
tpch_q11/duckdb:parquet 246692827 / 279247336 / -11.7% 302891734 / 301469405 / +0.5% 0.81 / 0.93 / -12.1%
tpch_q12/duckdb:parquet 255994889 / 244321025 / +4.8% 312958743 / 281145014 / +11.3% 0.82 / 0.87 / -5.9%
tpch_q13/duckdb:parquet 374422726 / 382703043 / -2.2% 387778776 / 463219570 / -16.3% 0.97 / 0.83 / +16.9%
tpch_q14/duckdb:parquet 267745220 / 255047143 / +5.0% 312726685 / 301222259 / +3.8% 0.86 / 0.85 / +1.1%
tpch_q15/duckdb:parquet 206659349 / 191438501 / +8.0% 228834720 / 220554518 / +3.8% 0.90 / 0.87 / +4.0%
tpch_q16/duckdb:parquet 243034160 / 287313946 / -15.4% 256470653 / 301984087 / -15.1% 0.95 / 0.95 / -0.4%
tpch_q17/duckdb:parquet 256152545 / 258007938 / -0.7% 329458322 / 314199718 / +4.9% 0.78 / 0.82 / -5.3%
tpch_q18/duckdb:parquet 475117286 / 306425002 / +55.1% 🔴 646539829 / 355418381 / +81.9% 🔴 0.73 / 0.86 / -14.8%
tpch_q19/duckdb:parquet 254801807 / 241485587 / +5.5% 294184281 / 285468394 / +3.1% 0.87 / 0.85 / +2.4%
tpch_q20/duckdb:parquet 439319526 / 432599380 / +1.6% 504647986 / 540117093 / -6.6% 0.87 / 0.80 / +8.7%
tpch_q21/duckdb:parquet 443529236 / 417617294 / +6.2% 486923069 / 463876894 / +5.0% 0.91 / 0.90 / +1.2%
tpch_q22/duckdb:parquet 297396300 / 287438341 / +3.5% 318599594 / 253402369 / +25.7% 0.93 / 1.13 / -17.7%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant